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for too many people who study differential equations, their only exposure 
to this amazingly rich and rewarding field of mathematics is through a 
textbook that lands with an 800-page whump on their desk. And what follows 
is a weary struggle as the reader tries to scale the impenetrable fortress of 
the massive tome. 

Has no one ever thought to write a book on differential equations from the 
reader's point of view? Yes indeed — that's where this book comes in. 



About This Book 

Differential Equations For Dummies is all about differential equations from 
your point of view. I've watched many people struggle with differential equa- 
tions the standard way, and most of them share one common feeling: 
Confusion as to what they did to deserve such torture. 

This book is different; rather than being written from the professor's point 
of view, it has been written from the reader's point of view. This book was 
designed to be crammed full of the good stuff, and only the good stuff. No 
extra filler has been added; and that means the issues aren't clouded. In this 
book, you discover ways that professors and instructors make solving prob- 
lems simple. 

You can leaf through this book as you like. In other words, it isn't important 
that you read it from beginning to end. Like other For Dummies books, this one 
has been designed to let you skip around as much as possible — this is your 
book, and now differential equations are your oyster. 



Contentions Used in This Book 

Some books have a dozen confusing conventions that you need to know 
before you can even start reading. Not this one. Here are the few simple con- 
ventions that I include to help you navigate this book: 
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*>* Italics indicate definitions and emphasize certain words. As is customary 
in the math world, I also use italics to highlight variables. 



faced text highlights important theorems, matrices (arrays of num- 
), keywords in bulleted lists, and actions to take in numbered steps. 

u* Mono font points out Web addresses. 

When this book was printed, some Web addresses may have needed to break 
across two lines of text. If that happens, rest assured that I haven't put in any 
extra characters (such as hyphens) to indicate the break. So when using one 
of these Web addresses, type in exactly what you see in this book, pretending 
as though the line break doesn't exist. 



What You're Not to Read 

Throughout this book, I share bits of information that may be interesting to 
you but not crucial to your understanding of an aspect of differential equa- 
tions. You'll see this information either placed in a sidebar (a shaded gray 
box) or marked with a Technical Stuff icon. I won't be offended if you skip 
any of this text — really! 



Foolish Assumptions 

This book assumes that you have no experience solving differential equations. 
Maybe you're a college student freshly enrolled in a class on differential equa- 
tions, and you need a little extra help wrapping your brain around them. Or 
perhaps you're a student studying physics, chemistry, biology, economics, 
or engineering, and you quickly need to get a handle on differential equations 
to better understand your subject area. 

Any study of differential equations takes as its starting point a knowledge of 
calculus. So I wrote this book with the assumption in mind that you know 
how to take basic derivatives and how to integrate. If you're totally at sea 
with these tasks, pick up a copy of Calculus For Dummies by Mark Ryan 
(Wiley) before you pick up this book. 



HouJ This Book Is Organized 

The world of differential equations is, well, big. And to handle it, I break that 
world down into different parts. Here are the various parts you see in this book. 



Introduction 



Part 1: Focusing on First Order 
ipBOCfKfe rcwt ^' Equations 



I start this book with first order differential equations — that is, differential 
equations that involve derivatives to the first power. You see how to work 
with linear first order differential equations (linear means that the derivatives 
aren't squared, cubed, or anything like that). You also discover how to work 
with separable first order differential equations, which can be separated so 
that only terms in y appear on one side, and only terms in x (and constants) 
appear on the other. And, finally, in this part, you figure out how to handle 
exact differential equations. With this type of equation you try to find a func- 
tion whose partial derivatives correspond to the terms in a differential equa- 
tion (which makes solving the equation much easier). 



Part 11: Surveying Second and Higher 
Order Differential Equations 

In this part, I take things to a whole new level as I show you how to deal with 
second order and higher order differential equations. I divide equations into 
two main types: linear homogeneous equations and linear nonhomogeneous 
equations. You also find out that a whole new array of dazzling techniques 
can be used here, such as the method of undetermined coefficients and the 
method of variation of parameters. 



Part 111: The Porter Stuff: Advanced 
Techniques 

Some differential equations are tougher than others, and in this part, I bring 
out the big guns. You see heavy-duty techniques like Laplace transforms and 
series solutions, and you start working with systems of differential equations 
You also figure out how to use numerical methods to solve differential equa- 
tions. These are methods of last resort, but they rarely fail. 



Part IV: The Part of Tens 

You see the Part of Tens in all For Dummies books. This part is made up of 
fast-paced lists of ten items each; in this book, you find ten online differential 
equation tutorials and ten top online tools for solving differential equations. 
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ind several icons in the margins of this book, and here's what they 




This icon marks something to remember, such as a law of differential equa- 
tions or a particularly juicy equation. 



The text next to this icon is technical, insider stuff. You don't have to read it 
if you don't want to, but if you want to become a differential equations pro 
(and who doesn't?), take a look. 



This icon alerts you to helpful hints in solving differential equations. If you're 
looking for shortcuts, search for this icon. 



When you see this icon, watch out! It indicates something particularly tough 
to keep an eye out for. 



Where to Go from Here 

You're ready to jump into Chapter 1. However, you don't have to start there if 
you don't want to; you can jump in anywhere you like — this book was writ- 
ten to allow you to do just that. But if you want to get the full story on differ- 
ential equations from the beginning, jump into Chapter 1 first — that's where 
all the action starts. 



Part 



"Reusing on First 
Order Differential 
Equations 



The 5 th Wave 



By Rich Tennant 



|Shet^ "Equations 



Ah, yes...utnmm...AHA/ 



Nov*, let's see. AKMi HA' 

maqatiAw indeed i 




f Giwme 




DropBooks 



In this part . . . 

/n this part, I welcome you to the world of differential 
equations and start you off easy with linear first order 
differential equations. With first order equations, you 
have first order derivatives that are raised to the first 
power, not squared or raised to any higher power. I also 
show you how to work with separable first order differen- 
tial equations, which are those equations that can be sep- 
arated so that terms in y appear on one side and terms in 
x (and constants) appear on the other. Finally, I introduce 
exact differential equations and Euler's method. 



Chapter 1 

OC TOlcome to the World of 
Differential Equations 



In This Chapter 

Breaking into the basics of differential equations 
Getting the scoop on derivatives 
Checking out direction fields 

Putting differential equations into different categories 
Distinguishing among different orders of differential equations 
Surveying some advanced methods 



t's a tense moment in the physics lab. The international team of high- 
powered physicists has attached a weight to a spring, and the weight is 
bouncing up and down. 

"What's happening?" the physicists cry. "We have to understand this in terms 
of math! We need a formula to describe the motion of the weight!" 

You, the renowned Differential Equations Expert, enter the conversation 
calmly. "No problem," you say. "I can derive a formula for you that will 
describe the motion you're seeing. But it's going to cost you." 

The physicists look worried. "How much?" they ask, checking their grants 
and funding sources. You tell them. 

"Okay, anything," they cry. "Just give us a formula." 

You take out your clipboard and start writing. 

"What's that?" one of the physicists asks, pointing at your calculations. 



Part I: Focusing on First Order Differential Equations 



pBooRS 

"I've got i 



"That," you say, "is a differential equation. Now all I have to do is to solve it, 
and you'll have your formula." The physicists watch intently as you do your 
ightning speed. 



it," you announce. "Your formula is y = 10 sin (5f), where y is the 
weight's vertical position, and t is time, measured in seconds." 

"Wow," the physicists cry, "all that just from solving a differential equation?" 



"Yep," you say, "now pay up." 



Well, you're probably not a renowned differential equations expert — not yet, 
at least! But with the help of this book, you very well may become one. In this 
chapter, I give you the basics to get started with differential equations, such 
as derivatives, direction fields, and equation classifications. 



The Essence of Differential Equations 




In essence, differential equations involve derivatives, which specify how a 
quantity changes; by solving the differential equation, you get a formula for 
the quantity itself that doesn't involve derivatives. 



Because derivatives are essential to differential equations, I take the time in 
the next section to get you up to speed on them. (If you're already an expert 
on derivatives, feel free to skip the next section.) In this section, however, 
I take a look at a qualitative example, just to get things started in an easily 
digestible way. 

Say that you're a long-time shopper at your local grocery store, and you've 
noticed prices have been increasing with time. Here's the table you've been 
writing down, tracking the price of a jar of peanut butter: 



Month 


Price 


1 


$2.40 


2 


$2.50 


3 


$2.60 


4 


$2.70 


5 


$2.80 



6 



$2.90 
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Looks like prices have been going up steadily, as you can see in the graph 
of the prices in Figure 1-1. With that large of a price hike, what's the price of 
utter going to be a year from now? 







2.90 -i 






2.80 - 






2.70 - 










u 


2.60 - 




a. 








2.50 - 


Figure 1-1: 




2.40 - 


The price of 






peanut 






butter by 




1 


month. 









You know that the slope of a line is Ay/ Ax (that is, the change in y divided by 
the change in x). Here, you use the symbols Ap for the change in price and At 
for the change in time. So the slope of the line in Figure 1-1 is Ap/At. 

Because the price of peanut butter is going up 10 cents every month, you 
know that the slope of the line in Figure 1-1 is: 

^ = 10<t/month 

The slope of a line is a constant, indicating its rate of change. The derivative 
of a quantity also gives its rate of change at any one point, so you can think of 
the derivative as the slope at a particular point. Because the rate of change of 
a line is constant, you can write: 

$ = f =HH/month 

In this case, dp/dt is the derivative of the price of peanut butter with respect 
to time. (When you see the d symbol, you know it's a derivative.) 

And so you get this differential equation: 

^ = 10<t/month 
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The previous equation is a differential equation because it's an equation that 
involves a derivative, in this case, dp/dt. It's a pretty simple differential equa- 
you can solve for price as a function of time like this: 



p = lOf + c 

In this equation, p is price (measured in cents), t is time (measured in months), 
and c is an arbitrary constant that you use to match the initial conditions of 
the problem. (You need a constant, c, because when you take the derivative of 
lOf + c, you just get 10, so you can't tell whether there's a constant that should 
be added to lOf — matching the initial conditions will tell you.) 

The missing link is the value of c, so just plug in the numbers you have for 
price and time to solve for it. For example, the cost of peanut butter in month 1 
is $2.40, so you can solve for c by plugging in 1 for t and $2.40 for p (240 cents), 
giving you: 



240 = 10 + c 



By solving this equation, you calculate that c = 230, so the solution to your 
differential equation is: 



p= 10?+ 230 



And that's your solution — that's the price of peanut butter by month. You 
started with a differential equation, which gave the rate of change in the price 
of peanut butter, and then you solved that differential equation to get the 
price as a function of time, p = 10? + 230. 

Want to see the solution to your differential equation in action? Go for it! Find 
out what the price of peanut butter is going to be in month 12. Now that you 
have your equation, it's easy enough to figure out: 

p= lOf + 230 
10(12) + 230 = 350 

As you can see, in month 12, peanut butter is going to cost a steep $3.50, 
which you were able to figure out because you knew the rate at which the 
price was increasing. This is how any typical differential equation may work: 
You have a differential equation for the rate at which some quantity changes 
(in this case, price), and then you solve the differential equation to get 
another equation, which in this case related price to time. 

Note that when you substitute the solution (p = lOf + 230) into the differential 
equation, dp/dt indeed gives you 10 cents per month, as it should. 
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Deri</ati</e$: The Foundation of 
mj^miSat Equations 

As I mention in the previous section, a derivative simply specifies the rate at 
which a quantity changes. In math terms, the derivative of a function f(x), 
which is depicted as df(x)/dx, or more commonly in this book, as f'(x), indi- 
cates how f(x) is changing at any value of x. The function f(x) has to be con- 
tinuous at a particular point for the derivative to exist at that point. 




Take a closer look at this concept. The amount f(x) changes in a small distance 
along the x axis Ax is: 



f(x + Ax) - f(x) 

The rate at which fix) changes over the change Ax is: 

f(x + Ax)-f(x) 
Ar 

So far so good. Now to get the derivative dy/dx, where y = f(pc), you must let 
Ax get very small, approaching zero. You can do that with a limiting expres- 
sion, which you can evaluate as Ax goes to zero. In this case, the limiting 
expression is: 

dy f(x + Ax) - fix) 

dx A*^o Ax 

In other words, the derivative of f(x) is the amount f(x) changes in Ax, divided 
by Ax, as Ax goes to zero. 



I take a look at some common derivatives in the following sections; you'll see 
these derivatives throughout this book. 



Derivatives that are constants 

The first type of derivative you'll encounter is when f(x) equals a constant, c. 
If f(x) = c, then f(x + Ax) = c also, and f(x + Ax) - f(x) = 0 (because all these 
amounts are actually the same), so df(x)/dx = 0. Therefore: 
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How about when f(x~) = cx, where c is a constant? In this case, f(x) = cx, and 
f(x + Ax) = cx + c Ax. 



•) - f(x) = c Ax and (ftx + Ax) - f(xJ)IAx = c. Therefore: 



f(x) = cx 



df(x) 
dx 



beriVatiVes that are porters 

Another type of derivative that pops up is one that includes raising x to the 
power n. Derivatives with powers work like this: 

. df ( x ) _ „ 



fix) 



dx 



Raising e to a certain power is always popular when working with differential 
equations (e is the natural logarithm base, e = 2.7128 . . ., and a is a constant): 

„ df(x) 



f(x) 



dx 



a e" 



And there's also the inverse of e", which is the natural log, which works like 
this: 

f(x) = ln(x) ^>=1 



bertVatiVes involving trigonometry 

Now for some trigonometry, starting with the derivative of sin(x): 
f(x) = s\n(x) ^^ = cos(x) 



And here's the derivative of cos(x): 
df{x) 



f(x) = cos(x) 



dx 



sin(x) 



Deri(/ati(/es inVoiVinq multiple functions 

The derivative of the sum (or difference) of two functions is equal to the sum 
(or difference) of the derivatives of the functions (that's easy enough to 
remember!): 

df(x) d a(x) d b(x) 
f(x) = a(x)±b(x) 4r = T ± ^ i 
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The derivative of the product of two functions is equal to the first function 
times the derivative of the second, plus the second function times the deriva- 
e first. For example: 



. ... . df{x) . ,db{x) ul ,d a(x) 
f(x) = a(x) b(x) = a(x)—^>- + b(x)—^± 

How about the derivative of the quotient of two functions? That derivative is 
equal to the function in the denominator times the derivative of the function 
in the numerator, minus the function in the numerator times the derivative 
of the function in the denominator, all divided by the square of the function 
in the denominator: 

a(x) df(x) _ b(x)—fc < x )^x- 

( ' b(x) dx b(x f 



Seeing the Big Picture 
With Direction Fields 



It's all too easy to get caught in the math details of a differential equation, 
thereby losing any idea of the bigger picture. One useful tool for getting an 
overview of differential equations is a direction field, which I discuss in more 
detail in Chapter 2. Direction fields are great for getting a handle on differen- 
tial equations of the following form: 



dy 
dx 



f{x,y) 



The previous equation gives the slope of the equation y = f(pc) at any point x. A 
direction field can help you visualize such an equation without actually having 
to solve for the solution. That field is a two-dimensional graph consisting of 
many, sometimes hundreds, of short line segments, showing the slope — that 
is, the value of the derivative — at multiple points. In the following sections, 
I walk you through the process of plotting and understanding direction fields. 



Plotting a direction field 

Here's an example to give you an idea of what a direction field looks like. 
A body falling through air experiences this force: 

F = mg - y v 



Part I: Focusing on First Order Differential Equations 



tne accele 

>pBoate 

through tf 



In this equation, Fis the net force on the object, m is the object's mass, g is 
the acceleration due to gravity (g = 9.8 meters/sec 2 near the Earth's surface), 
[rag coefficient (which adds the effect of air friction and is measured 

s sec/meter), and v is the speed of the object as it plummets 
the air. 



If you're familiar with physics, consider Newton's second law. It says that 
F= ma, where Fis the net force acting on an object, m is its mass, and a is its 
acceleration. But the object's acceleration is also dv/dt, the derivative of the 
object's speed with respect to time (that is, the rate of change of the object's 
speed). Putting all this together gives you: 

F = ma = m Q = mg — y v 

Now you're back in differential equation territory, with this differential equa- 
tion for speed as a function of time: 

Now you can get specific by plugging in some numbers. The acceleration due 
to gravity, g, is 9.8 meters/sec 2 near the Earth's surface, and let's say that the 
drag coefficient is 1.0 newtons sec/meter and the object has a mass of 4.0 kilo- 
grams. Here's what you'd get: 

dv _ no v 
dt ~ y ' 8 4 

^jcjMSEfl To get a handle on this equation without attempting to solve it, you can plot 
it as a direction field. To do so you create a two-dimensional plot and add 
dozens of short line segments that give the slope at those locations (you can 
do this by hand or with software). The direction field for this equation 
appears in Figure 1-2. As you can see in the figure, there are dozens of short 
lines in the graph, each of which give the slope of the solution at that point. 
The vertical axis is v, and the horizontal axis is t. 

Because the slope of the solution function at any one point doesn't depend 
on t, the slopes along any horizontal line are the same. 



Connecting slopes into an integral cmVe 

You can get a visual handle on what's happening with the solutions to a dif- 
ferential equation by looking at its direction field. How? All those slanted line 
segments give you the solutions of the differential equations — all you have 
to do is draw lines connecting the slopes. One such solution appears in 
Figure 1-3. A solution like the one in the figure is called an integral curve of 
the differential equation. 
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n see from Figure 1-3, there are many solutions to the equation that 
ying to solve. As it happens, the actual solution to that differential 
equation is: 



v = 39.2 + ce 



-f/4 



In the previous solution, c is an arbitrary constant that can take any value. 
That means there are an infinite number of solutions to the differential 
equation. 

But you don't have to know that solution to determine what the solutions 
behave like. You can tell just by looking at the direction field that all solutions 
tend toward a particular value, called the equilibrium value. For instance, you 
can see from the direction field graph in Figure 1-3 that the equilibrium value 
is 39.2. You also can see that equilibrium value in Figure 1-4. 
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Classifying Differential Equations 
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ifferential equations exist in Math and Science Land, and the way 
you tackle them differs by type. As a result, there are several classifications 
that you can put differential equations into. I explain them in the following 
sections. 



Classifying equations by order 

The most common classification of differential equations is based on order. 
The order of a differential equation simply is the order of its highest deriva- 
tive. For example, check out the following, which is a first order differential 
equation: 



dy 
dx 



5x 



Here's an example of a second order differential equation: 

dx 2 dx 



And so on, up to order n: 



dx" 



16 



dx 



n-l ^ 



+ 14 



dx 2 



urn 

dx 



I9x + 4 = 0 



As you might imagine, first order differential equations are usually the most 
easily managed, followed by second order equations, and so on. I discuss 
first order, second order, and higher order differential equations in a bit more 
detail later in this chapter. 



Classifying ordinary Versus 
partial equations 

You can also classify differential equations as ordinary or partial. This classifi- 
cation depends on whether you have only ordinary derivatives involved or 
only partial derivatives. 
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An ordinary (non-partial) derivative is a full derivative, such as dQ/dt, where 
you take the derivative of all terms in Q with respect to t. Here's an example 
jinary differential equation, relating the charge Q(t) in a circuit to the 
stive force E(t) (that is, the voltage source connected to the circuit): 



you laxe in 
^■aflB-^in 



L^S + R^ + lQ = E { t) 



dt 2 



dt C 



Here, Q is the charge, L is the inductance of the circuit, Cis the capacitance 
of the circuit, and E(f) is the electromotive force (voltage) applied to the cir- 
cuit. This is an ordinary differential equation because only ordinary deriva- 
tives appear. 



On the other hand, partial derivatives are taken with respect to only one vari- 
able, although the function depends on two or more. Here's an example of a 
partial differential equation (note the squiggly <f s): 

.d 2 u(x,t) du(x,t) 



dx 2 



dt 



In this heat conduction equation, a is a physical constant of the system that 
you're trying to track the heat flow of, and u(x, f) is the actual heat. 

Note that u(x, t) depends on both x and t and that both derivatives are partial 
derivatives — that is, the derivatives are taken with respect to one or the 
other of x or t, but not both. 

In this book, I focus on ordinary differential equations, because partial differ- 
ential equations are usually the subject of more advanced texts. Never fear 
though: I promise to get you your fair share of partial differential equations. 



Classifying linear Versus 
nonlinear equations 



^jjjABEfl Another way that you can classify differential equations is as linear or non- 
linear. You call a differential equation linear it it exclusively involves linear 
terms (that is, terms to the power 1) of y, y', y", and beyond to y (n \ For exam- 
ple, this equation is a linear differential equation: 

d 2 Q dQ i n _ F(n 
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Note that this kind of differential equation usually will be written this way 
throughout this book. And this form makes the linear nature of this equation 



LQ"+RQ'+±Q = E(t) 




On the other hand, nonlinear differential equations involve nonlinear terms in 
any of y, y', y", up to y (n) . The following equation, which describes the angle of 
a pendulum, is a nonlinear differential equation that involves the term sin 6 
(not just 6): 

^ + f-sin6 = 0 

Handling nonlinear differential equations is generally more difficult than han- 
dling linear equations. After all, it's often tough enough to solve linear differ- 
ential equations without messing things up by adding higher powers and 
other nonlinear terms. For that reason, you'll often see scientists cheat when 
it comes to nonlinear equations. Usually they make an approximation that 
reduces the nonlinear equation to a linear one. 

For example, when it comes to pendulums, you can say that for small angles, 
sin 6 = 6. This means that the following equation is the standard form of the 
pendulum equation that you'll find in physics textbooks: 

9> + fe=o 

As you can see, this equation is a linear differential equation, and as such, 
it's much more manageable. Yes, it's a cheat to use only small angles so that 
sin 6 = 6, but unless you cheat like that, you'll sometimes be reduced to using 
numerical calculations on a computer to solve nonlinear differential equa- 
tions; obviously these calculations work, but it's much less satisfying than 
cracking the equation yourself (if you're a math geek like me). 



Sotrinq First Order Differential Equations 

Chapters 2, 3, and 4 take a look at differential equations of the form f'(pc) = 
f(x, y); these equations are known as first order differential equations 
because the derivative involved is of first order (for more on these types 
of equations, see the earlier section "Classifying equations by order." 
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First order differential equations are great because they're usually the most 
solvable. I show you all kinds of ways to handle first order differential equa- 
hapters 2, 3, and 4. The following are some examples of what you 
forward to: 



As you know, first order differential equations look like this: f'Qc) = f(x, y). 
In the upcoming chapters, I show you how to deal with the case where 
fQc, y) is linear in x — for example, f'Qc) = 5x — and then nonlinear in x, 

as in f'Qc) = Sx 2 . 

v* You find out how to work with separable equations, where you can 
factor out all the terms having to do with y on one side of the equation 
and all the terms having to do with x on the other. 

I also help you solve first order differential equations in cool ways, such 
as by finding integrating factors to make more difficult problems simple. 



Direction fields, which I discuss earlier in this chapter, work only for equa- 
tions of the type f'Qc) = fQc, y) — that is, where only the first derivative is 
involved — because the first derivative of fQc) gives you the slope of f(pc) at 
any point (and, of course, connecting the slope line segments is what direc- 
tion fields are all about). 



Tackling Second Order and Higher Order 
differential Equations 

As noted in the earlier section "Classifying equations by order," second order 
differential equations involve only the second derivative, d 2 y/dx 2 , also known 
as y". In many physics situations, second order differential equations are 
where the action is. 

For example, you can handle physics situations such as masses on springs or 
the electrical oscillations of inductor-capacitor circuits with a differential 
equation like this: 

y"-ay = 0 

In Part II, I show you how to tackle second order differential equations with a 
large arsenal of tools, such as the Wronskian matrix determinant, which will tell 
you if there are solutions to a second (or higher) order differential equation. 
Other tools I introduce you to include the method of undetermined coefficients 
and the method of variation of parameters. 
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After first and second order differential equations, it's natural to want to keep 
the fun going, and that means you'll be dealing with higher order differential 
s, which I also cover in Part II. With these high-end equations, you 
s like d"y/dx", where n > 2. 




The derivative cfy/cbd' is also written as y (n) . Using the standard syntax, deriv- 
atives are written as y', y", y'", y 1 ", y°, and so on. In general, the nth derivative 
of y is written as y { "\ 

Higher order differential equations can be tough; many of them don't have 
solutions at all. But don't worry, because to help you solve them I bring to 
bear the wisdom of more than 300 years of mathematicians. 



Hatfinq fun With Advanced Techniques 

You discover dozens of tools in Part III of this book; all of these tools have been 
developed and proved powerful over the years. Laplace Transforms, Euler's 
method, integrating factors, numerical methods — they're all in this book. 

These tools are what this book is all about — applying the knowledge of hun- 
dreds of years of solving differential equations. As you may know, differential 
equations can be broken down by type, and there's always a set of tools devel- 
oped that allows you to work with whatever type of equation you come up 
with. In this book, you'll find a great many powerful tools that are just waiting 
to solve all of your differential equations — from the simplest to the seemingly 
impossible! 
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Chapter 2 



Differential Equations 



In This Chapter 

Beginning with the basics of solving linear first order differential equations 
Using integrating factors 

Determining whether solutions exist for linear and nonlinear equations 



JM s you find out in Chapter 1, a first order differential equation simply has 
v \ a derivative of the first order. Here's what a typical first order differen- 
tial equation looks like, where f(t, y) is a function of the variables t and y (of 
course, you can use any variables here, such as x and y or u and v, not just t 
and y): 



In this chapter, you work with linear first order differential equations — that 
is, differential equations where the highest power of y is 1 (you can find out 
the difference between linear and nonlinear equations in Chapter 1). For 
example: 





y+1 



dL 
dt 



3y+ 1 



I provide some general information on nonlinear differential equations at the 
end of the chapter for comparison. 
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First Things First: The Basics of Sotting 
pBtQ&\£Bst Order Differential Equations 

In the following sections, I take a look at how to handle linear first order dif- 
ferential equations in general. Get ready to find out about initial conditions, 
solving equations that involve functions, and constants. 



Appiqinq initial conditions from the start 

When you're given a differential equation of the form dy/dt = f(t, y), your goal 
is to find a function, y(f), that solves it. You may start by integrating the equa- 
tion to come up with a solution that includes a constant, and then you apply 
an initial condition to customize the solution. Applying the initial condition 
allows you to select one solution among the infinite number that result from 
the integration. Sounds cool, doesn't it? 

Take a look at this simple linear first order differential equation: 
dy 

As you can see, a is just a regular old number, meaning that this is a simple 
example to start with and to introduce the idea of initial conditions. How can 
you solve it? First of all, you may have noticed that another way of writing 
this equation is: 

dy = adt 

This equation looks promising. Why? Well, because now you can integrate 
like this: 

y i 

f dy= j adt 

Performing the integration gives you the following equation: 
y-y a = at-at 0 

You can combine y 0 - at 0 into a new constant, c, by adding y 0 to the right side 
of the equation, which gives you: 



y = at+c 
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That was simple enough, right? And guess what? You're done! The solution to 
this differential equation is y = at + c. 



ample, if a = 3 in the differential equation, here's the equation you 
would have: 

^ = 3 
dt 6 

The solution for this equation is y = 3f + c. 

Note that c, the result of integrating, can be any value, which leads to an infi- 
nite set of solutions: y = 3t + 5, y = 3t + 6, y = 3t + 589,303,202. How do you track 
down the value of c that works for you? Well, it all depends on your initial con- 
ditions; for example, you may specify that the value of y at t = 0 be 15. Setting 
this initial condition allows you to state the whole problem — differential 
equation and initial condition — as follows: 

dy = 3 
dt 6 

y(0) = 15 

Substituting the initial condition, y(0) = 15, into the solution y = 3f + c gives 
you the following equation: 

y(f) = 3f + 15 



Stepping up to soivinq differential 
equations inVoitfinq functions 

Of course, dy/dt = 3 (the example from the previous section) isn't the most 
exciting differential equation. However, it does show you how to solve a dif- 
ferential equation using integration and how to apply an initial condition. The 
next step is to solve linear differential equations that involve functions of t 
rather than just a simple number. 

This type of differential equation still contains only dy/dt and terms of t, 
making it easy to integrate. Here's the basic form: 

£-«<o 

where g(f) is some function of t. 

Here's an example of this type of differential equation: 
dt 
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Well, heck, that's easy too; you simply rearrange to get this: 
? dt-3f dt+ tdt 
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Then you can integrate to get this equation: 



Adding a couple of constants to the mix 

The next step up from equations such as dy/dx = a or dy/dt = g(t) are equa- 
tions of the following form, which involve y, dy/dt, and the constants a and b: 

d y h 

How do you handle this equation and find a solution? Using some handy alge- 
bra, you can rewrite the equation like this: 

dy/dt _ n 



y-{b/a) 

Integrating both sides gives you the following equation: 

In I y - (b/d) I = at + c 

where c is an arbitrary constant. Now get y out of the natural logarithm, 
which gives you: 

y = (b/d) + de at 

where d = e c . And that's it! You're done. Good job! 

Soltiinq Linear First Order Differential 
Equations With Integrating Factors 

jfcJftB&f Sometimes integrating linear first order differential equations isn't as easy as 
it is in the examples earlier in this chapter. But it turns out that you can often 
convert general equations into something that's easy to integrate if you find 
an integrating factor, which is a function, |i(f). The idea here is to multiply the 
differential equation by an integrating factor so that the resulting equation 
can easily be integrated and solved. 




In the following sections, I provide tips and tricks for solving for an integrating 
factor and plugging it back into different types of linear first order equations. 
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1, first order differential equations don't lend themselves to easy 
bn, which is where integrating factors come in. How does the method 
of integrating factors work? To understand, say, for example, that you have 
this linear differential equation: 



dy 
dt 



+ 2y = 4 



First, you multiply the previous equation by |i(f), which is a stand-in for the 
undetermined integrating factor, giving you: 

t i(/)^ + 2ji(0y = 4 t i(f) 

Now you have to choose |4,(f) so that you can recognize the left side of this 
equation as the derivative of some expression. This way it can easily be 
integrated. 

Here's the key: The left side of the previous equation looks very much like 
differentiating the product |i(f)y. So try to choose so that the left side of 
the equation is indeed the derivative of n(?)y. Doing so makes the integration 
easy. 



The derivative of [i(t)y by t is: 



d[\i(t)y] 



dt 



d\i(t)y 



dt pv ' dt dt 
Comparing the previous two equations term by term gives you: 



<M0 

dt 



2u(r) 



Hey, not bad. Now you're making progress! This is a differential equation you 
can solve. Rearranging the equation so that all occurrences of u(f) are on the 
same side gives you: 

d\i{t)ldt _ 

Now the equation can be rearranged to look like this: 
dii(t) 



n(0 



2dt 



Fine work. Integration gives you: 

In I jlxCO I =2t+b 
where b is an arbitrary constant of integration. 
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Now it's time for some exponentiating. Exponentiating both sides of the 
equation gives you: 
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where c is an arbitrary constant. 

So that's it — you've solved for the integrating factor! It's n(f) = ce 2 '. 

Using an integrating factor to solve 
a differential equation 

After you solve for an integrating factor, you can plug that factor into the 
original linear differential equation as multiplied by \i(t). For instance, take 
your original equation from the previous section: 

l i(/)^+2ji(f)>'=4 l i(0 
and plug in the integrating factor to get this equation: 

ce a ^ + 2ce 2 'y=4ce 2 ' 

Note that c drops out of this equation when you divide by c, so you get the 
following equation (because you're just looking for an arbitrary integrating 
factor, you could also set c = 1): 

e 2 '^ + 2e 2l y = 4e 2 ' 

^.VABEfl When you use an integrating factor, you attempt to find a function |a(f) that, 
jfcN, when multiplied on both sides of a differential equation, makes the left side 
into the derivative of a product. Figuring out the product allows you to solve 
the differential equation. 

In the previous example, you can now recognize the left side as the derivative 
of e 2 ' y. (If you can't recognize the left side as a derivative of some product, in 
general, it's time to go on to other methods of solving the differential equation). 

In other words, the differential equation has been conquered, because now 
you have it in this form: 

dt qe 

You can integrate both sides of the equation to get this: 



e 2 'y = 2e 2 ' + c 
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You've got yourself a solution. Beautiful. 

The use of an integrating factor isn't always going to help you; sometimes, 
when you use an integrating factor in a linear differential equation, the left 
side isn't going to be recognizable as the derivative of a product of functions. 
In that case, where integrating factors don't seem to help, you have to turn to 
other methods. One of those methods is to determine whether the differen- 
tial equation is separable, which I discuss in Chapter 3. 



Moving on up: Using integrating factors in 
differential equations With functions 

Now you're going to take integrating factors to a new level. Check out this 
linear equation, where g(f) is a function of t: 

% + ay = g(t) 

This one's a little more tricky. However, using the same integrating factor 
from the previous two sections, e at (remember that the c dropped out), works 
here as well. After you multiply both sides by e"', you get this equation: 

e° l ^ + ae"y = e° , g(t) 

Now you can recast this equation in the following form: 

d(e°'y) 

To integrate the function g, I use s as the variable of integration. Integration 
gives you this equation: 

e°'y= f e as g(s)ds + c 
You can solve for y here, which gives you the following equation: 

y=e~ a f e as g(s)ds + ce-°' 
And that's it! You've got your answer! 

Of course, solving this equation depends on whether you can calculate the 
integral in the previous equation. If you can do it, you've solved the differential 
equation. Otherwise, you may have to leave the solution in the integral form. 
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Trying, a special shortcut 



ction, I give you a shortcut for solving some particular differential 
iWs. Ready? Here's the tip: In general, the integrating factor for an 
equation in this form: 

% + ay = g{t) 



is this: 

\i(t) = exp J a dt 
In this equation, exp(x) means e x . 

As an example, try solving the following differential equation with the shortcut: 
1 



dy 
dt 



2 -y = 4 + f 
Assume that the initial condition is 



y = 8, when t = 0 

This equation is an example of the general equation solved in the previous 
section. In this case, g(t) = 4 + t, and a = 34 

Using a, you find that the integrating factor is e f/2 , so multiply both sides of 
equation by that factor: 



e ,l2 ^ + fy = 4e , < 2 +te , > 2 



Now you can combine the two terms on the left to give you this equation: 

d(e" 2 y) 



dt 



Ae'^+te' 1 




All you have to do now is integrate this result. The term on the left and the 
first term on the right are no problem. The last term on the right is another 
story. 

You can use integration by parts to integrate this term. Integration by parts 
works like this: 



/ f(x)g'(x)dx=f(b)g(b) 

a 

-f{a)g{a)- j f'{x)g(x)dx 



Chapter 2: Looking at Linear First Order Differential Equations 



ipBooks 



Applying integration by parts to the last term on the right, and integrating 
the others, gives you: 



8e'" + 2te t "-4e'" + c 




where c is an arbitrary constant, set by the initial conditions. Dividing by e a 
gives you this equation: 

y = 4 + It + ce"' 

By applying the initial condition, y(0) = 8, you get 

y(0) = 8 

8 = 4 + c 

Or c = 4. So the general solution of the differential equation is: 

y = 4 + It + Ae" 2 

In Chapter 1, 1 explain that direction fields are great tools for visualizing dif- 
ferential equations. You can see a direction field for the previously noted 
general solution in Figure 2-1. 



Figure 2-1: 

The 
direction 
field of the 
general 
solution. 
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Connecting the slanting lines in a direction field gives you a graph of the solu- 
tion. You can see a graph of this solution in Figure 2-2. 



Figure 2-2: 

The graph of 
the general 
solution. 




Soivinq an advanced example 

I think you're ready for another, somewhat more advanced, example. Try 
solving this differential equation to show that you can have different integrat- 
ing factors: 

where y(l) = 4. 

To solve, first you have to find an integrating factor for the equation. To get it 
into the form: 

% + ay = g{t) 

you have to divide both sides by t, which gives you this equation: 
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To find the integrating factor, use the shortcut equation from the previous 
section, like this: 

DropBooks ex P / a , f exp/i„ 

Performing the integral gives you this equation: 

u(f) = exp f |df=e 21n l'l=f 2 

So the integrating factor here is f, which is a new one. Multiplying both sides 
of the equation by the integrating factor, \i(f) = f, gives you: 

t 2 ^ + 2ty=4t 3 

Because the left side is a readily apparent derivative, you can also write it in 
this form: 

dt ~ qi 

Now simply integrate both sides to get: 

yf = tUc 
Finally you get: 

y = t* + f t 

where c is an arbitrary constant of integration. 

Now you can plug in the initial condition y(l) = 4, which allows you to see 
that c = 3. And that helps you come to this solution: 

And there you have it. You can see a direction field for the many general solu- 
tions to this differential equation in Figure 2-3. 
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field of a 
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You can see this function graphed in Figure 2-4. 



Figure 2-4: 

The graph of 3 
a more 
advanced 
solution. 2 
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)pBtQ&\£B$t Order Equation Exists 



I show you how to deal with different kinds of linear first order differential 
equations earlier in this chapter, but the fact remains that not all linear differ- 
ential equations actually do have a solution. 

Luckily a theorem exists that tells you when a given linear differential equa- 
tion with an initial condition has a solution. That theorem is called the exis- 
tence and uniqueness theorem. 

This theorem is worth knowing. After all, if a differential equation doesn't have 
a solution, what use is it to search for a solution? In other words, this theorem 
represents another way to tackle linear first order differential equations. 



Spelling out the existence and uniqueness 
theorem for linear differential equations 

jjcJABEfl in this section, I explain what the existence and uniqueness theorem for linear 
y w\ differential equations says. Before I continue, however, note that a continuous 

jjJIJjl ) function is a function for which small changes in the input result in small 
VOBy changes in the output (for example, f(x) = l/x is not continuous at x = 0). 
Without further ado, here's the existence and uniqueness theorem: 

If there is an interval / that contains the point t a , and if the functions 
and g(x) are continuous on that interval, and if you have this differential 
equation: 

^+p(x)y = g(x) 

then there exists a unique function, y(x}, that is the solution to that differen- 
tial equation for each x in interval / that also satisfies this initial condition: 

KQ = y« 

where y„ is an arbitrary initial value. 



In other words, this theorem says that a solution exists and that the solution 
is unique. 
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Finding the general solution 



' about the theorem in the previous section begs the question: What 
leral solution to the following linear differential equation? 

% + P{x)y = g{x) 

^jttNG/ Note that this differential equation has a function p(x) and g(x), which pro- 
^<a=\ vides a more complex situation. So you can't use the simple form I explain in 
the earlier section "Adding a couple of constants to the mix," where a and b 
are constants like this: 

d y 

The solution here is: 

y = (bid) + ce"' 

Now you face a more complex situation, with functions p(x) and g(x). A gen- 
eral solution to the general equation does exist, and here it is: 

f H(«) g(s) ds + c 

y- 1 w) 

where the integrating factor is the following: 



H(f) = exp f p(t)dt 



The integrals in these equations may not be possible to perform, of course. 
But together, the equations represent the general solution. 

Note that for linear differential equations, the solution, if there is one, is com- 
pletely specified, up to a constant of integration, as in the solution you get in 
the earlier section "Solving an advanced example": 

y = t 2 +f, 

where c is a constant of integration. 

^jUBEfl You can't necessarily say the same thing about nonlinear differential 
y w\ equations — they may have solutions of completely different forms, not just 
) differing in the value of a constant. Because the solution to a linear differen- 
VBB / tial equation has one form, differing only by the value of a constant, those 
solutions are referred to as general solutions. This term isn't used when dis- 
cussing nonlinear differential equations, which may have multiple solutions 
of completely different forms. I discuss nonlinear first order differential equa- 
tions later in this chapter. 
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In this section, I include a few examples to help you understand the existence 
and uniqueness theorem for linear differential equations. 



Example 1 

Apply the existence and uniqueness theorem to the following equation to 
show that there exists a unique solution: 

dy = 4x 
dx (y-5) 

Just kidding! This equation isn't linear because the term (y-5) is in the denom- 
inator of the right side. And, of course, because the equation isn't linear, the 
existence and uniqueness theorem doesn't apply. Did you catch that? 



Example 2 

Try this differential equation (which I promise is linear!). Does a unique solu- 
tion exist? 

i + »-J - 

where y(l) = 2. 

The equation is already in the correct form: 

|£ + p(x)y = g(x) 
where p(x) = 2 and g(x~) = ^x 2 . 



Note that p(x) and g(x) are continuous everywhere, so there's a general solu- 
tion that's valid on the interval, -« < x < <x>. 

In particular, the initial condition is y(l) = 2, which is definitely inside the 
interval that p(pc) and g(x) are continuous (everything is inside that interval). 
So, yes, there exists a solution to the initial value problem. 



Example 3 

Now take a look at this equation, which is similar to the example in the previ- 
ous section, and determine whether a unique solution exists: 

x%- + 2y=4x> 



where y(l) = 2. 
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The next step is to put the equation into this form: 

dy 



&p{x)y = g{x) 



Here's what the equation should look like: 

^ + £ = Ax 
In other words: 

and 

g(x) = Ax 

Note that p(x) and g(pc) aren't continuous everywhere. In particular, p(x) is 
discontinuous at x = 0, which makes the interval in which p(pc) and g(x) are 
continuous on the interval 0 > x and 0 < x. 

Because the initial condition here is y(l) = 2, the point of interest is x = 1, 
which is inside the interval where p(x) and g(x) are continuous. Therefore, by 
the existence and uniqueness theorem, the initial value problem indeed has a 
unique solution. Cool, huh? 



Figuring Out Whether a Solution for a 
Nonlinear differential Equation Exists 

In the previous sections of this chapter, I cover linear first order differential 
equations in detail. But you may be wondering: Is there such a thing as a non- 
linear differential equation? You bet there is! A nonlinear differential equation 
simply includes nonlinear terms in y, y', y", and so on. Nonlinear equations 
are pretty tough, so I don't delve into them a lot in this book. But I do want to 
discuss one important theorem related to solving these equations. 

You see, the existence and uniqueness theorem (which you use for linear 
equations, and which I cover earlier in this chapter) is analogous to another 
theorem that's used for nonlinear equations. I explain this theorem and show 
some examples in the following sections. 



Chapter 2: Looking at Linear First Order Differential Equations 



The existence and uniqueness theorem for 
Qj\^pear differential equations 

Here's the existence and uniqueness of solutions for nonlinear equations: 

Say that you have a rectangle R that contains the point (t„, v„) and that the 
functions /"and dfjdy are continuous in that rectangle. Then, in an interval 
t 0 -h<t<t 0 + h contained in R, there's a unique solution to the initial 
value problem: 

% = f(t,y),y(t l> )=y ll 

Note that this theorem discusses the continuity of both /'and dfjdy instead of 
the continuity of both p(x) and g(x). Like the first theorem in this chapter, 
this theorem guarantees the existence of a unique solution if its conditions 
are met. 

Here's another note: If the differential equation in question actually is linear, 
the theorem reduces to the first theorem in this chapter. In that case, f(t, y) = 
-p(t)y + g(f) and dfjdy = -p(f). So demanding that /and dfjdy be continuous is 
the same as saying that p(t) and g(f) be continuous. 

Here's a side note that many differential equations books won't tell you: The 
first theorem in this chapter guarantees a unique solution, but it's actually a 
little tighter than it needs to be in order to guarantee just a solution (which 
isn't necessarily unique). In fact, you can show that there's a solution — but 
not that it's unique — to the nonlinear differential equation merely by proving 
that / is continuous. 

A couple of nonlinear existence and 
uniqueness examples 

In the following sections, I provide two examples that put the nonlinear exis- 
tence and uniqueness theorem into action. 

Example 1 

Determine what the two theorems in this chapter have to say about the fol- 
lowing differential equation as far as its solutions go: 

dy _ 5x 2 + 9x+ 6 
dx 2(y-4) 

where y(0) = -1. 
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Well, as you can see, this is a nonlinear equation in y. So the first theorem, 
which deals only with linear differential equations, has nothing to say about it. 



ns you need the nonlinear theorem. Note that for this theorem: 

K y) 2(y-4) 

and 

df_ = 5x 2 + 9x+6 
dy 2 (y-4) 2 

These two functions, /'and dfjdy, are continuous, except at y = 4. 

So you can draw a rectangle around the initial condition point, (0, -1) in which 
both /and dfjdy are continuous. And the existence and uniqueness theorem 
for nonlinear equations guarantees that this differential equation has a solu- 
tion in that rectangle. 

Example 2 

Now determine what the existence and uniqueness theorems say about this 
differential equation: 

where y(l) = 0. 

Clearly, this equation isn't linear, so the first theorem is no good. Instead you 
have to try the second theorem. Here, /is: 

Kx,y) = y V5 

and dfjdy is: 

df _ y" 4/s 



dy 5 

Now you know that fix, y) is continuous at the initial condition point given by: 

y(i) = o 

But dfjdy isn't continuous at this point. The upshot is that neither the first 
theorem nor the second theorem have anything to say about this initial value 
problem. On the other hand, a solution to this differential equation is still 
guaranteed because f(x, y) is continuous. However, it doesn't guarantee the 
uniqueness of that solution. 
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ing Out Separable First Order 
Differential Equations 



In This Chapter 

Figuring out the fundamentals of separable differential equations 
Applying separable differential equations to real life 
Advancing with partial fractions 



\ome rocket scientists call you, the Consulting Differential Equation 
Expert, into their headquarters. 

"We've got a problem," they explain. "Our rockets are wobbling because we 
can't solve their differential equation. All the rockets we launch wobble and 
then crash!" 



They show you to a blackboard with the following differential equation: 

dy x 2 

dx 2-y 2 

"It's not linear," the scientists cry. "There's ay 2 in there!" 
"I can see that," you say. "Fortunately, it is separable." 
"Separable? What does that mean?" they ask. 

"Separable means that you can recast the equation like this, where x is on 
one side and y is on the other," you say while showing them the following 
equation on your clipboard: 

(2-f)dy = x 2 dx 

"You can integrate the equation with respect to y on one side, and x on the 
other," you say. 

"We never thought of that. That was too easy." 
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That's what this chapter covers: separable first order differential equations. 
(First order equations, as I note in Chapter 1, have derivatives that go up only 
t order.) I explain the basics of separable equations here, such as 
ing the difference between linear and nonlinear separable equations 
guring out different types of solutions, such as implicit and explicit. I also 
introduce you to a fancy method for solving separable equations involving 
partial fractions. Finally, I show you a couple of real world applications for 
separable equations. When you're an expert at these equations, you too can 
solve problems for rocket scientists. 



Beginning With the Basics of Separable 
differential Equations 



Separable differential equations, unlike general linear equations in Chapter 2, 
let you separate variables so only variables of one kind appear on one side, 
and only variables of another kind appear on the other. Say, for example, that 
you have a differential equation of the following form, in which M and ./Vare 
functions: 

M(x,y) + N(x,y)^ = 0 

And furthermore, imagine that you could reduce this equation to the follow- 
ing form, where the function M depends only on x and the function N depends 
only on y: 

M(x) + N(y)^ = 0 

This equation is a separable equation; in other words, you can separate the 
parts so that only x appears on one side, and only y appears on the other. 
You write the previous equation like this: 



M(x) dx + N(y) dy = 0 
Or in other words: 

M(x) dx = -N(y) dy 

If you can separate a differential equation, all that's left to do at that point is 
to integrate each side (assuming that's possible). Note that the general form 
of a separable differential equation looks like this: 

dy 



M(x) + N(y)^ = 0 
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However, nothing here says that N(y) has to be linear in y. For example, con- 
sider this separable differential equation that isn't linear: 



And if you're still not convinced, check out this one, which is also separable 
but not linear: 



In the following sections, I ease you into linear separable equations before 
tackling nonlinear separable equations. I also show you a trick for turning 
nonlinear equations into linear equations. (It's so cool that it'll impress all 
your friends!) 



Starting easy: Linear separable equations 



To get yourself started with linear separable equations, say that you have 
this differential equation: 



This equation qualifies as linear. This also is an easily separated differential 
equation. All you have to do is put it into this form: 



And now you should be able to see the idea behind solving separable differ- 
ential equations immediately. You just have to integrate, which gives you this 
equation: 



where c is an arbitrary constant. There's your solution! How easy was that? 



Not all separable equation solutions are going to be as easy as the one in the 
previous section. Sometimes finding a solution in the y = f(pc) format isn't ter- 
ribly easy to get. Mathematicians refer to a solution that isn't in the form 
y = f(pc) as an implicit solution. Coming up with such a solution is often the 
best you can do, because solving a separable differential equation involves 





dy -dddx 



y = f + c 



Introducing implicit solutions 
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integrating both sides of the equation, and there's no guarantee that the inte- 
gration will come out cleanly. (The form y = f(pc) is known as an explicit solu- 
w you how to find an explicit solution from an implicit solution in 
ection.) 



4? 



Try this differential equation to see what I mean: 

dy _ x 2 
dx 2-y 2 

How about it? One of the first things that should occur to you is that this isn't 
a linear differential equation, so the techniques in the first part of this chap- 
ter won't help. However, you'll probably notice that you can write this equa- 
tion as: 

(2-f)dy = x 2 dx 

As you can see, this is a separable differential equation because you can put y 
on one side and x on the other. You can also write the differential equation 
like this: 

-x 2 + (2-f)^ = 0 

You can cast this particular equation in terms of a derivative of x, and then 
you integrate with respect to x to solve it. After integration, you wind up with 



the following: 

, d(-x*/3) 
^ B -% ~ X ~ dx 

Note that: 

dy _</(2y-y 3 /3) 



( 2 -y 2 )-dx- dx 

because of the chain rule, which says that: 

df_ = df_dy_ 
dx dy dx 

So now you can write the original equation like this: 

If the derivative of the term on the right is 0, it must be a constant this way: 
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Finally, multiplying by 3 gives you the following implicit solution to your origi- 
nal separable equation: 



6y-/ = c 



To see how the solutions look graphically, check out the direction field for this 
differential equation in Figure 3-1. (I introduce direction fields in Chapter 1.) 




-4-3-2-1 0 1x2 3 4 



Finding explicit solutions from 
implicit solutions 

The implicit solution in the previous section, with terms in y and y i , isn't ter- 
ribly easy to cram into the y = f(pc) format. In this section, you discover that 
you can find an explicit solution to a separable equation by using a quadratic 
equation, which is the general solution to polynomials of order two. 

Try another, somewhat more tractable problem. Solve this differential 
equation: 

dy _ 9x 2 + 6x + 4 
dx 2(y-l) 

where y(0) = -1. 
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If this differential equation were of the following form: 
dy 



ar+ 6x + 4 



there would be no problem. After all, you would just integrate. But you've 
probably noticed that pesky 2(y - 1) term in the denominator on the right 
side. Fortunately, you may also realize that this is a separable differential 
equation because you can put y on one side and x on the other. Simply write 
the equation like this: 



2(y- 1) dy = (9.x 2 + 6x + 4) dx 
Now you integrate to get this equation: 

y 2 - 2y = 3X 3 + 3x* +4x + c 

Using the initial condition, y(0) = -1, substitute x = 0 and y = -1 to get the 
following: 

1 +2 = c 

Now you can see that c = 3 and that the implicit solution to the separable 
equation is: 

y 2 - 2y = 3X 3 + 3x* +4x + 3 

¥\ H vou want to find the explicit solution to this and similar separable equa- 
tions, simply solve for y with the quadratic equation because the highest 
power of y is 2. Solving for y using the quadratic formula gives you: 

y= 1 + /3x 3 + 3x 2 + Ax + 4 

You have two solutions here: one where the addition sign is used and one 
where the subtraction sign is used. To match the initial condition that y(0) = 
-1, however, only one solution will work. Which one? The one using the sub- 
traction sign: 



y= 1 -/3x 3 +3x 2 +4x+4 

In this case, the solution with the subtraction is valid as long as the expres- 
sion under the square root is positive — in other words, as long as x > -1. 

You can see the direction field for the general solutions to this differential 
equation in Figure 3-2. 
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Figure 3-2: 

The 
direction 
field of a 
separable 
equation 
with initial 
conditions. 
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As I note in Chapter 1, connecting the slanting lines in a direction field gives 
you a graph of the solution. You can see a graph of this particular function in 
Figure 3-3. 



2 -r 
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Most of the time, you can find an explicit solution from an implicit solution. 
But every once in a while, getting an explicit solution is pretty tough to do. 
Here's an example: 



dy 
dx 



ysmx 



[l + 2f) 
where y(0) = 1 . 

As you get down to work (bringing to bear all your differential equation skills!), 
the first thing that may strike you is that this equation isn't linear. But, you'll 
also likely note that it's separable. So simply separate the equation into y on 
the left and x on the right, which gives you this equation: 



'l + 2f)dy 

y 



sinx dx 



dy 

y 



This equation subsequently becomes 

2y dy = sinx dx 

Now you can integrate to get this: 

Inly I + y 2 = -cos x + c 

Next, take a look at the initial condition: y(0) = 1. Plugging that condition into 
your solution gives you this equation: 

0 + 1 = -1 + c 

or 



So your solution to the initial separable equation is: 

Inly I + y 2 = -cos x + 2 

This is an implicit solution, not an explicit solution, which would be in terms 
of y = f(pc). In fact, as you can see from the form of this implicit solution, get- 
ting an explicit solution would be no easy task. 



Chapter 3: Sorting Out Separable First Order Differential Equations 




However, never fear the implicit solution! You still can use numerical or graphi- 
cal methods to deal with such solutions. For instance, take a look at the direc- 
, for this differential equation, which indicates what the integral curves 
) in Figure 3-4. 



cai me 



Figure 3-4: 

The 
direction 
field of a 
separable 
equation 
with a hard- 
to-find 
explicit 
solution. 




A neat trick: Turning nonlinear separable 
equations into linear separable equations 

In this section, I introduce you to a neat trick that helps with some differen- 
tial equations. With it, you can make a linear equation out of a seemingly non- 
linear one. All you have to do to use this trick is to substitute the following 
equation, in which v is a variable: 

y = xv 

In some cases, the result is a separable equation. 

As an example, try solving this differential equation: 

dy _2y 4 +x 4 



dx 



xy 
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At first glance, this equation doesn't look separable. In fact, even if you break 
it out into two fractions, it still doesn't look separable: 



x y 3 



What do you do now? Keep reading to find out. 



Knowing When to substitute 

You can use the trick of setting y = xv when you have a differential equation 
that's of the following form: 

when f(x, y) = f(tx, ty), where t is a constant. 

You can see that substitution is possible, because substituting tx and ty into 
this differential equation gives you the following result: 

dy _ 2t*y*+ t'x" 
dx 



txt 3 y 3 



which breaks down to: 

dy _ 2y 4 + x 4 



dx xy 3 

Substituting y = xv into this differential equation gives you: 

v | x dv _ 2{xvy+x 4 
dx x{xvf 

This equation now can be simplified to look like this: 

dv _ v 4 + 1 
dx v 3 

You now have a separable equation! 



Separating and integrating 

Continuing with the example from the previous section, you can now sepa- 
rate the terms, which gives you: 

dx _ ifdv 
x v 4 + 1 
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After you integrate both sides, you get the following equation: 



where c is a constant of integration. Bearing in mind that, where k is a constant: 

ln(x) + ln(fe) = ln(fce) 
and that: 

n ln(x) = ln(x") 
you get: 

v A + 1 = (fee) 4 



c = -ln(fe) 

Where does all this get you? You're ready to substitute with the following: 

-I 

This substitution gives you: 




where: 




So: 



4 4 I 

y + x = mx 



where m = k 4 . And solving for y gives you the following: 



y = (mx* - x 4 ) 



1/4 



And there's your solution. Nice work! 
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In the following sections, I take a look at some real world examples featuring 
separable equations. 



Getting in control With a sample 
flow problem 

To understand the relevance of differential equations in the real world, here's 
a sample problem to ponder: Say that you have a 10-liter pitcher of water, and 
that you're mixing juice concentrate into the pitcher at the same time that 
you're pouring juice out. If the concentrate going into the pitcher has % kg of 
sugar per liter, the rate at which the concentrate is going into the pitcher, 
which I'll call r ln , is Vim liter per second, and the juice in the pitcher starts off 
with 4 kg of sugar, find the amount of sugar in the juice, Q, as a function of 
time, t. 

Because this problem involves a rate — dQ/dt, which is the change in the 
amount of sugar in the pitcher — it's a differential equation, not just a simple 
algebraic equation. I walk you through the steps of solving the equation in 
the following sections. 

Determining the basic numbers 

When you start trying to work out this problem, remember that the change in 
the amount of sugar in the pitcher, dQ/dt, has to be the rate of sugar flow in 
minus the rate of sugar flow out, or something like this: 



dQ 
dt 



(rate of sugar flow in) — (rate of sugar flow out) 



Now you ask: What's the rate of sugar flow in? That's easy; it's just the con- 
centration of sugar in the juice concentrate multiplied by the rate at which 
the juice concentrate is flowing into the pitcher, which I'll call r in . So, your 
equation looks something like this: 

(rate of sugar flow in) = -jr kg/sec 

Now what about the flow of sugar out? The rate of sugar flow out is related to 
the rate at which juice leaves the pitcher. So if you assume that the amount of 
juice in the pitcher is constant, then r in = r out = r. That, in turn, means the rate 
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of sugar flow out is the rate at which the juice leaves the pitcher, r, multiplied 
by the concentration of sugar in the juice, which is Q divided by the capacity 
cher (10 liters), or Q/10. Here's what your equation would look like: 



rate of sugar flow out) = ^ r kg/sec 
So that means: 

= (rate of sugar flow in) - (rate of sugar flow out) = ^ — ^ 



where the initial condition is: 



Oo = 4 kg 



Solving the equation 

The equation at the end of the previous section is separable, and separating 
the variables, each on their own side, gives you this equation: 

dQ,Q L = L 
dt 10 4 

Now that, you might say, is a linear differential in Q. And you'd be right. So you 
know that the equation is both linear and separable. 



You can handle this differential equation using the methods in Chapter 2. For 
instance, to solve, you find an integrating factor, multiply both sides by the 
integrating factor, and then see if you can figure out what product the left 
side is the derivative of and integrate it. Whew! It sounds rough, but note that 
the equation is of the following form: 

The solution to this kind of differential equation is already found in Chapter 2; 
you use an integrating factor of e"'. The solution to this kind of equation is: 

y = (bid) + ce"' 

So you can see that the solution to the juice flow problem is: 

0(0 = 2.5 + ce rtlw 
Because r = l Aw liter per second, the equation becomes: 
0(0 = 2.5 ♦ ce" im 
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And because the initial condition is: 

4 kg 
you know that: 

Q = 2.5 + 1.5e- ,/100 ° 



Note the solution as t —> <x> is 2.5 kg of sugar, and that's what you'd expect. 
Why? Because the concentrate has K kg of sugar per liter, and 10 liters of 
water are in the pitcher. So 10/4 = 2.5 kg. 

The direction field for different values of Q 0 appears in Figure 3-5. Notice that 
all the solutions tend toward the final Q of 2.5 kg of sugar, as you'd expect. 
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Figure 3-5: 

The 
direction 
field of a 

flow 
problem 
solution. 
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You can see a graph of this solution in Figure 3-6. 
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Figure 3-6: 

The graph of 
the solution 
of a flow 
problem. 
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Striking it rich With a sample 
monetary problem 

You may not have realized that differential equations can be used to solve 
money problems. Well they can! And here's a problem to prove it: Say that 
you're deciding whether to deposit your money in the bank. You can calcu- 
late how your money grows, dQ/dt, given the interest rate of the bank and the 
amount of money Q, that you have in the bank. As you can see, this is a job 
for differential equations. 

Figuring out the general solution 

Suppose your bank compounds interest continuously. The rate at which your 
savings, Q, grows, is: 

dt rlJ 



where r is the interest rate that your bank pays. 
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This equation says that the rate at which your money grows is equal to the 
interest rate multiplied by the current amount of money you have. That's an 
, for the rate at which your money grows, not the actual amount of 
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Say that you have Oo money at t = 0: 



0(0) = Oo 

How much money would you have at a certain time in the future? That's easy 
enough to figure out. Separate the variables, each on their own side, like this: 




Then integrate: 
In I (?l =rt 

Finally, exponentiate both sides, which gives you the following equation: 

Q = ce r ' 

To match the initial condition: 

0(0) = Oo 
the solution becomes 

0 = 0oe rt 




So, in other words, your money would grow exponentially. Not bad. 



Compounding interest at set interi/ats 

Now I want you to examine the result from the previous section a little, deriv- 
ing it another way so that it makes more sense. If your bank compounded 
interest once a year, not continuously, after t years, you'd have this much 
money: 



0 = 0o(l + r)' 

That's because if your interest was 5 percent, after the first year, you would 
have 1.050o; at the end of the second year, 1.05 2 0o, and so on. 
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What if your bank compounded interest twice a year? Would you have this 
much at the end of t years: 
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No, you wouldn't. Why? Because that would pay you r percent interest twice 
a year. For example, if r = 8 percent, the previous equation would pay you 8 
percent of your total savings twice a year. Instead, banks divide the interest 
rate they pay you by the number of times they compound per year, like this: 



O = 0o(i+f) 

In other words, if the bank compounds twice a year, and the annual interest 
rate is 8 percent, six months into the year it pays you 4 percent, and at the 
end of the year it pays another 4 percent. 




In general, if your bank compounds interest m times a year, after t years, 
you'd have: 



Q = <?o(i+m) 

If you take the limit asm->oo — that is, as your bank starts to compound 
continuously — you get this equation: 

ml 

O = lim(? 0 (l+i) 

But that's just the expansion for e". So, as the bank compounds continuously, 
you get: 

ml 

0=limO G (l+^j =Q 0 e" 

And this result confirms the answer you got from solving the differential 
equation in the previous section. 

So if you had $25 invested, and you left it alone at 6 percent for 60 years, 
you'd have: 

O=O„e rt =25e 0O6C60) 

or: 

Q=Q 0 e rt =25e 006(60) = $914.96 
Hmm, not such a magnificent fortune. 
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Adding a set amount of money 

Hqjw about if you add a set amount every year to the equation in the previous 
That would be better, wouldn't it? Say that you add $5,000 a year. In 
remember that the set amount would change the differential equa- 
tion for your savings, which was this: 



dQ 
dt 



rQ 



The equation would change to this, where k is the amount you contribute 
regularly: 



dQ 
dt 



rQ + k 



If you deposit regularly, k > 0; if you withdraw regularly, k < 0. Ideally, you 
should add or subtract k from your account continuously over the year to 
make your solution exact, but here you can just assume that you add or sub- 
tract k once a year. 



dQ 
dt 



dy 
dt 



Putting this new equation into standard separable form gives you this: 
rQ=k 

This equation is of the following form: 
ay = b 

The solution to this kind of equation is: 

y = {b/d) + ce"' 
In this case, that solution means: 

Q = ce r '-k/r 

What's going on here? It looks like you have the solution for leaving money in 
the bank without adding anything minus the amount you've added. Can that 
be right? The answer is in c, the constant of integration. Here, the initial con- 
dition is: 

0(0) = Oo 
which means that: 

0(0) = ce* - k/r = c - k/r = Q 0 
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or to simplify things: 
k/r 

So your solution turns out to be: 

Q = ce" - k/r = (Qo + k/f)e" - k/r 

Working this out gives you: 

Q = (Q 0 +k/r)e"-k/r=Q 0 e"+${e"- 1) 

That looks a little better! Now the first term is the amount that you'd earn if 
you just left Q a in the account, and the second term is the amount resulting 
from depositing or withdrawing k dollars regularly. 

For example, say you started off with $25, but then you added $5,000 every 
year for 60 years. At the end of 60 years at 6 percent, you'd have: 

Q = Q 0 e"+ £(e ff - 1) = 25e 006(60) + ^^(e 006(60) - l) 



After calculating this out, you'd get: 

5,00( 
0.06 



q = 25e 0Mm + ^Se 006(60) - 1) = $914.96 + $2,966,519 = $2,967,434 



Quite a tidy sum. 



Break It Up! Usinq Partial fractions 
in Separable Equations 




When a term in a separable differential equation looks a little difficult to inte- 
grate, you can use the method of partial fractions to separate it. This method 
is used to reduce the degree of the denominator of a rational expression. 



For example, using the method of partial fractions, you can express: 
6 

x 2 + 2x-8 
as the following equation: 

6 _ 1 1_ 

x 2 +2x-8 x-2 x+A 
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Note that the power of the denominator has been reduced by one. You'll 
often see the method of partial fractions used when solving differential equa- 
tolving fractions, because using this method makes integrating the 
(two terms a lot easier. 
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Here's an example: 
2-xy 



dy 
dx 



x — y 



You're probably screaming at your book right now. That's not separable, you 
say. However, perhaps you've also noticed that this equation is of the follow- 
ing form: 



dy 
dx 



f(x,y) 



And f(x, y) = f(tx, ty), where t is a constant. So you now have this equation: 



dy 
dx 



Itxty 



t'x'-t'y' 



2xy 

r-y 2 



Yep, you guessed it: This equation calls for the old trick of substituting y = vx. 
(See the earlier section "A neat trick: Turning nonlinear separable equations 
into linear separable equations" for details.) Substituting y = vx into this dif- 
ferential equation gives you the following equation: 



v + x 



dv 



2x(xv) 



dx x 2 -(xv) 
or to simplify matters: 

dv _ 2v 



V + X 



dx 1 



By subtracting the term on the right and adding to the left, you get the 
following: 



x^ + 
dx 



v(v 2 + 11 



0 



y-i) 

Flipping the fractions gives you: 



dx 



+ 



v 



1 



v{v 2 + 1) 



dv = 0 
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Time to use the method of partial fractions. In this case, you get the following 
equation: 
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or to simplify: 

dx , 2v dv dv r. 
* v 2 + 1 v 

Ah, much better. Now you can integrate! Integrating all these terms gives you: 
lnlxl + \n\v 2 + II - In 1 1! I = c 

or: 

In Ixl + In I v 2 + 1 1 = Inl v\ + c 
Exponentiating both sides gives you this equation: 

x(v 2 + 1) = kv 
where k = e c . 

Substituting v = y/x gives you the following: 

x(y 2 +x 2 ) _ ky 
x 2 ~ x 

The previous equation can then be simplified to the implicit solution of the 
following: 

y 2 + x 2 = ky 

or to simplify even further: 

y 2 - ky + x 2 = 0 

Finally, you can solve using the quadratic equation to get the following 
explicit solution: 

k±Jk 2 -Ax 2 

y= — 2 — 
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Chapter 4 

Exploring Exact 
First Order Differential 
Equations and Euler's Method 

In This Chapter 

Understanding the fundamentals of exact differential equations 

Figuring out whether differential equations are exact 

Turning nonexact equations into exact equations with integrating factors 

Crunching numbers with Euler's method 

Digging into difference equations 

J\lot all first order differential equations are linear (see Chapter 2) or 
# w separable (see Chapter 3). So sometimes you have to use other tools to 
solve first order differential equations. One of those tools is knowing how 
to solve exact differential equations. That's what I introduce you to in this 
chapter. And for those really intractable (a.k.a. difficult) differential equa- 
tions, you also get an introduction to working with mathematical methods. In 
particular, you find out how to use Euler's method to approximate solutions 
to just about any differential equation (assuming it has a solution!). And you 
find out that Euler's method is a type of difference equation (don't worry; 
I explain everything). 

Exploring the Basics of Exact 
Differential Equations 

One of the most powerful methods for working with differential equations is 
seeing whether they're exact, and if they are, you can tackle them. I explain 
the basics in the following sections. 
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Defining exact differential equations 

an exact differential equation, you have to find a function whose 
erivatives correspond to the terms in the differential equation. For 
example, assume that you have a differential equation of this form: 

M(x,y) + N(x,y)^ = 0 

where M and N are functions. 

Now suppose that you can find a function f(x, y) such that the following equa- 
tions are true: 



dx 



M(x,y) 
N(x,y) 



Note that the previous two equations are partial derivatives with respect 
to x, so I include the symbol 3. (Check out Chapter 1 for more about partial 
derivatives.) 

The differential equation that you're trying to solve becomes: 

df(x,y) df(x,y) dy 
dx dy dx 

which is equal to (note: ordinary derivatives now): 

df(x,y) 



dx 



0 



So the solution, after integration, is: 

f(x, y) = c 

The previous solution is at least the implicit solution; you may have to move 
things around a bit to get the actual explicit solution. (As I explain in Chapter 3, 
implicit solutions aren't in the form y = f(x), but explicit solutions are.) 

Here's the point: If you can find a function fsuch that a differential equation 
can be reduced to the following form: 

df(x,y) n 



dx 



then the differential equation is said to be exact. 
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Working out a typical exact 
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Exact differential equations can be tough to solve, so in this section, I provide 
a typical example so you can get the hang of it. Check out this differential 
equation: 

4x+2y 2 +4xy |£ = 0 

This equation isn't linear, and it also isn't separable. However, you may sus- 
pect that the equation is exact. So, if that's the case, how do you solve it? 

You might note that this function has some interesting properties: 

f(x,y) = 2x 2 + 2xy 2 

In particular, note that df/dx (note: this is the partial derivative with respect 
to x) is: 



K 

dx 



Ax + 2y 2 



Those are the first two terms of the equation you're looking to solve. Also, 
note that 



3y 



Axy 



which looks a lot like the third term in the original equation. So you could 
write the equation like this: 



dx dy dx 



0 



You're making progress! Note that because y is a function of f, you can use the 
chain rule (see Chapter 3) and switch to ordinary derivatives, meaning that 
you can write the original equation like this: 



dL 
dx 

where 



0 



f(x, y) = 2x? + 2xy 2 
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The ordinary derivative I just gave you is easy to integrate, so you get the fol- 
lowing equation: 



where c is a constant of integration. That's the implicit solution. Now you can 
divide by 2, absorbing that 2 into c, which gives you: 

x 2 + xy 2 = c 

So that's your implicit solution. But it's easy to solve for y, as you can see in 
this equation: 



y '■ 



Determining Whether a differential 
Equation 1$ Exact 

As you can see from the previous section, knowing when a differential equa- 
tion is exact is helpful. But just when is it exact? Keep reading to find out. 

Checking out a useful theorem 




How can you tell, in a systematic way, whether a differential equation is 
exact? You're in luck: It turns out that there's a handy theorem to determine 
whether a differential equation is exact, and here it is: 



If the functions M, N, BM/dy, and dN/dx are continuous in a rectangle R, 
then this differential equation: 

M(x,y)+N(x,y)^ = 0 

is an exact differential equation in the rectangle R if and only if: 

dM(x,y) _ dN(x,y) 
dy dx 

at every point in R. 
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y) + N(x,y) 



dy 
dx 




there exists a function f(x, y) in a rectangle R such that: 

df(x,y) , , 



and 



df(x,y) 



N(x,y) 



dy 

if and only if: 

dM(x,y) 3N(x,y) 
dy ~ dx 

in the rectangle R. 

So how do you solve exact differential equations? You have to solve the par- 
tial differential equation: 



and 



df(x,y) . , 



df(x,y) , . 



And if you can find it, the implicit solution is f(x, y) = c. 



Applying the theorem 

So how about an example that shows how to apply the theorem in the previ- 
ous section? Take a look at this differential equation: 



2xy+(l +x 2 ) ^ = 0 



dy 
dx 
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In other words: 
y) = 2xy 

and 

Af(x,y) = (l + x 2 ) 
Note that 

dM(x,y) dN(x,y) 



dy dx 



2x 



So now you know that the differential equation is exact. And now you need to 
find M(x, y) and yV(x, y) such that: 

and 

When you find f(x, y), the solution to the original equation is 

fQc, y) = c 
Start by finding f(x, y). Because 

M(x,y) = 2xy 
that means 

-^r- = 2x y 

Integrating both sides of the previous equation gives you: 
f(x, y)=x 2 y + g(y) 

where g(y) is a function that depends only on y, not on x. So what's g(y)? You 
know that: 

df(x,y) . . 
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or 



dy 



l+x 2 



Because you know that 
f(x, y)=x 2 y + g(y) 

you get this equation: 
df(x,y 



dy - x+ iy-{y) = l+x 



By canceling out the x 2 , you get 



9y 



Fortunately, this equation is easy enough to integrate. Integrating it gives 
you this: 

g(y)=y + d 

where d is a constant of integration. And because 

f(x, y)=x 2 y + g(y) 
you get: 

f(x, y)=x 2 y + y + d 
Whew. You now know that the solution to f(x, y) = x^y + g(y) is: 

f(x, y) = c 

So 

x 2 y + y = c 

where the constant of integration d has been absorbed into the constant of 
integration c. 
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As you recall from the earlier section "Defining exact differential equations," 
finding f(x, y) gives you the implicit solution to the exact differential solution 
ing to solve. Happily, x*y + y = c is easy to solve for y in terms of x, 
u: 



' (1+* 2 ) 

And that, my friends, is the explicit solution to your original equation. Cool! 



Conquering Nonexact Differential 
Equations With Integrating Factors 

The earlier sections in this chapter cover exact differential equations. But 
what about those equations that don't look exact but can be converted into 
exact equations? Yes, you read that right! Sometimes, differential equations 
are intractable and not exact. For example, that's the case with this differen- 
tial equation: 

You start off by checking this differential equation for exactness, meaning 
that you have to cast it in this form: 

M(x,y) + N(x,y)^ = 0 

So, in the case of the example: 

M(x,y)=y 

and 

N(x,y) = -x 
The differential equation is exact if: 

dM(x,y) dN(x,y) 
dy dx 

But these two aren't equal; rather: 

dM(x,y) _ i 
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As you can see, the original equation isn't exact. However, the two partial 
derivatives, dM/dx and dN/dy, differ only by a minus sign. Isn't there some 
way of making this differential equation exact? 

Yup, you're right. There is a way! You just have to use an integrating factor. 
As I discuss in Chapter 2, integrating factors are used to multiply differential 
equations to make them easier to solve. In the following sections, I explain 
how to use an integrating factor to magically turn a nonexact equation into 
an exact one. 



Finding an integrating factor 

How can you find an integrating factor that makes differential equations 
exact? Just follow the steps in the following sections. 

Multiplying by the factor you Want to find 

Using the example from earlier, here I show you how to find an integrating 
factor that makes differential equations exact. Say you have this differential 
equation: 

M(x,y) + N(x,y)^ = 0 

Multiplying this equation by the integrating factor |i(x, y) (which you want to 
find) gives you this: 

\L(x,y) M(x,y) + ii(x,y)N(x,y) |£ = 0 
This equation is exact if: 

d(\i(x,y) M(x,y)) _ d(\i(x,y) N(x,y)) 
dy ~ dx 

which means that y) must satisfy this differential equation: 

. . d\i(x,y) , . 9|i(x,y) 



[dM(x,y)j dN(x,y) 



3y 



dx 



[i(x,y) = 0 
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Well, yipes. That doesn't seem to have bought you much simplicity In fact, 
this equation looks more complex than before. What you have to do now is to 
hat u(x, y) is a function of x only — that is, n(x, y) = |i(x) — which 
s that: 



ay 



o 



This turns the lengthy and complex equation into the following: 

dM(x,y) dN(x, y y 



, r/ , 3|i(x) 



ay 



dx 



Or in other words: 



"(*-y) 



dM(x,y) dN(x,y) 



ay 



dx 



|i(x) = 0 



\i(x) 



Dividing both sides by jV(x, y) to simplify means that: 



a\i(x) 

dx 



N(x,y) 



3M(x,y) 3N(x,y) 



ay 



dx 



H(x) 



Well, that looks somewhat better. You can see how to finish the example in 
the next section. 



Completing the process 

Remember the differential equation that you're trying to solve? If not, here it is: 

In this case, 
M(x,y)=y 

and 

N(x,y)=-x 

Plug these into your simplified equation from the previous section, which 
becomes: 



^)=^(l-(-l))n(x) 
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Now this equation can be rearranged to get this one: 

dH(*) _ _ 2 dx 
\i(x) x 



Integrating both sides gives you: 

lnl>(x)l = -2Inlxl 
And finally, exponentiating both sides results in this equation: 

For this differential equation: 

dM(x,y) 



ay 

and 

dN(x,y) 



1 



dx 



1 



Because these equations differ by a sign, you may suspect that you need the 
negative version of meaning that: 

So that, at last, is your integrating factor. Whew! 



Usinq an integrating factor 
to yet an exact equation 

To carry on from the example in the previous section: Multiplying your original 
equation by your integrating factor gives you this new differential equation: 

x 2 x dx u 
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Is this exact? To find out, consider that 
and 

The differential equation is exact if: 

dM(x,y) dN(x,y) 
dy ~ dx 

You can now see that these two terms are equal, because: 

3M(x,y) _ _! 
dy x 2 

and 

dN(x,y) _ _j 
dx x 2 

So the integrating factor, -l/x 2 , did the trick, and the equation is now exact. 

The finishing touch: Soitiinq the 
exact equation 

The last step is to solve the exact equation as I explain earlier in this chapter. 
In other words, you have to solve it by finding a function f(x, y) = c such that: 

df(x,y) . , 



and 

df(x,y) 



N(x,y) 



dy 

As noted in the previous section, 

M(x,y)=-^ 
which means that 

df(x,y) _ y 

dx 
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Integrating both sides of the equation gives you: 
And because, using the info from the previous section: 

you can see that 

g(y) = d 

where d is a constant of integration. So f(x, y) must be: 

f( x>y )=y+ d 

As you recall from the earlier section "Defining exact differential equations," 
the implicit solution of an exact differential equation is: 

f(pc, y) = c 

So: 

£ = c 

where the constant d has been absorbed into the constant c. Now you know 
that the explicit solution to the exact equation is: 

y = cx 

Cool. The solution turned out to be simple. 



Getting Numerical vOith Euler's Method 

Face it: Sometimes, you just can't find a solution to some differential equa- 
tions. Or, at best, you may only be able to find an implicit one. So what do 
you do? In that case, it could be time to turn to numerical methods — that is, 
using a computer. 



I know, using a computer feels a lot like a cop-out, but sometimes you have 
no other choice. Chapters 1, 2, and 3 all contain examples where I used a 
computer to calculate direction fields and plot some actual solutions. Now, in 
the following sections, I introduce one simple numerical method of solving 
differential equations. This method is called Euler's method. 
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So who was this Euler guy? 

KoftflcircffaEil tuW (1707-1783) was a Swiss and graph theory. He's also responsible for 

mathematician who lived, for the most part, in much of the mathematical terminology that 

Russia and Germany. He was an important people take for granted, such as the notation 

genius who contributed to physics, calculus, used for mathematical functions. 




Understanding the method 

Euler's method basically says "Hey, you may not have the actual curve that 
represents the solution to your differential equation, but you have the slope 
of that curve everywhere (because the slope — the rate of change of the 
curve — is the derivative)." 

To better understand what I mean, say that you have the following general 
differential equation: 

£-'(*>) 

And suppose that you have a point, (x 0 , y 0 ), that's on the solution curve. 
Because of your differential equation, you know that the slope of the solution 
curve at that point is f(x 0 , y„). 

Now imagine that you want to find the solution at a point, (x, y), a short dis- 
tance away. Here's how you might find y: 

y = y 0 + Ay 

Anything with the symbol A signifies change. So, Ay means a change in y. 
Because the slope, m, is defined as Ay/Ax, this equals (for small Ax): 

y = y 0 + m Ax 
And because Ax = x - x 0 , you have: 

y = y 0 + m(x-x 0 ) 

Because the slope, m, is equal to the derivative at (x 0 , y 0 ), and because of 
your original equation, m = f(x 0 , y 0 ), you get: 

y = y 0 + /(xo, y 0 ) (x - x 0 ) 
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So if you keep (x - x 0 ) small, this approximation should be close. All it's doing 
is using the slope to extrapolate (x 0 , y 0 ) to a new point nearby, (x, y). This 
s illustrated in Figure 4-1. 



Figure 4-1: 

Euler's 
method at 
work. 


















X 



If you call Ax by the term /?, as it's often referred to when using Euler's 
method, you get this: 



yi = y 0 + K x o< yo) h 



And in general, you can find any point along the solution curve like this, 
when using Euler's method: 

JVi =y„ + f(x m y„) h 



Checking the method's accuracy 
on a computer 

In this section, I put Euler's method to work, finding a solution to the follow- 
ing differential equation: 



dy 
dx 

where 



: x 



y(0) = 0 



Part I: Focusing on First Order Differential Equations 



In fact, you already know the solution by simply integrating: 
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Because 1 




Because you know the solution, you can now check the accuracy of Euler's 
method. And you're in luck, because here I show you how to develop a short 
program that uses Euler's method to solve differential equations. I developed 
this program using the Java programming language (which you can get for 
free at j ava . sun . com; just click the Java SE link under the Downloads tab). 

You don't have to know Java to use this book — the programming in this sec- 
tion is only a demonstration. But because numerical methods of solving dif- 
ferential equations require a computer, I use a programming language to get 
things working. You can skip this part if you aren't interested. 

befitting initial conditions and functions 

The Java program starts by defining the initial condition point — which is a 
solution point for the differential equation, by definition — (x 0 , y 0 ~). Then it 
defines the step size, h, and the number of steps you want to take, n. So, for 
example, if you have the initial point at (0, 0), and you want the solution at 
(10, y), your step size is 0.1, and you need n = 100 steps: 



double 


xO 


= 0.0; 




double 


yo 


= 0.0; 




double 


h = 


0.1; 




double 


n = 


100; 





At this point, the program also defines a Java function, f(x, y), that returns the 
value of the derivative at any point (x, y): 

public double f (double x, double y) 
{ 

return x; 

} 

Because you know the exact solution, you'll also set up a Java function to 
return the exact solution at any point so you can compare it to the Euler's 
method value: 

public double exact (double x, double y) 
{ 

return x * x / 2 ; 

} 
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The actual work is done in a Java function named "calculate." In this function, 
each step using Euler's method is calculated and displayed, like this: 



ic void calculate ( ) 



double x 
double y : 
double k; 



xO; 
yO; 



System. out .print In ( "x\t\tEuler\t\tExact " ) ; 



for (int i = 1 ; i < n; i++) { 
k = f (x, y) ; 
y = y + h * k; 
x = x + h; 

System. out .println (round (x) + "\t\t" 
"\t\t" + round (exact (x, 0 ) ) ) ; 

} 



round (y) + 



} 



The program also has a function named "round," which rounds values to two 
decimal places for the printout: 



public double round (double val) 
{ 

double divider = 100; 

val = val * divider; 

double temp = Math . round (val ) ; 

return (double) temp / divider; 



Examining the entire code 

The following is the whole code, e.java, which is a short program for calculat- 
ing differential equation solutions using Euler's method. The parts you have to 
change when you want to solve your own differential equations are in bold: 



public class e 
{ 



double xO = 0.0; 
double yO = 0.0; 
double h = 0.1; 
double n = 100; 



public e() 
{ 
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ic double f (double x, double y) 
return x; 



} 



public double exact (double x, double y) 
{ 

return x * x / 2; 

} 

public static void main (String [] argv) 
{ 

e de = new e ( ) ; 
de . calculate ( ) ; 

} 

public void calculate ( ) 
{ 

double x = xO ; 
double y = yO ; 
double k; 

System. out .print In ( "x\t\tEuler\t\tExact " ) ; 

for (int i = 1 ; i < n; i++) { 
k = f (x, y) ; 
y = y + h * k; 
x = x + h; 

System. out .println (round (x) + "\t\t" + round(y) + 
"\t\t" + round(exact (x, 0 ) ) ) ; 

} 

} 



public double round (double val) 
{ 

double divider = 100; 

val = val * divider; 

double temp = Math . round (val ) ; 

return (double) temp / divider; 

} 



An example at utork 

In this section, I put the program to work. As it stands, e.java is set up with 
the following differential equation: 
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where 



The nroe 



0 



The program starts at (x 0 , y 0 ~) = (0, 0), which you know is a point on the solu- 
tion curve, and then it calculates 100 steps, each of Ax = 0.1. 



You start by using the Java compiler, javac.exe, to compile the code: 



C:\>javac e.java 



Then, you run the compiled code, e. class, using java.exe like this: java e. The 
program then prints out the current x value, the Euler approximation of the 
solution at that x value, and the exact solution, as you see here: 



C: 


: \ > j ava e 










X 




Euler 


Exact 


0, 


. 1 


0 


.0 


0 . 


.01 


0 , 


. 2 


0 


. 01 


0 


. 02 


0, 


.3 


0 


.03 


0 


.05 


0 , 


. 4 


0 


.06 


0 


. 08 


0 , 


. 5 


0 


.1 


0 


. 13 


0 , 


. 6 


0 


. 15 


0 


. 18 


0 , 


. 7 


0 


.21 


0 


.24 


0 , 
0, 


. 8 


u. 
0 


.28 


— ' tr. 


.32 


.9 


.36 


0 


.4 


1. 


.0 


0 


.45 


0 


. 5 


1. 


. 1 


0 


.55 


0 


.6 


1. 


.2 


0 


.66 


0 


.72 


1. 


.3 


0 


.78 


0 


.85 


1, 


.4 


0 


.91 


0. 


.98 


1, 


. 5 


1. 


.05 


1 


.13 


1. 


.6 


1. 


.2 


1 


.28 


1. 


.7 


1 


.36 


1 . 


.45 


1. 


.8 


1 


.53 


1 


. 62 


1. 


.9 


1. 


.71 


1 


.81 


2 , 


.0 


1 


.9 


2 


.0 


2 , 


. 1 


2 


.1 


2 


.21 


2 . 


.2 


2 


.31 


2 


.42 


2 . 


,3 


2 . 


.53 


2 . 


. 65 


2 . 


.4 


2 . 


.76 


2 . 


.88 


2 . 


, 5 


3 . 


.0 


3 . 


.13 


2 . 


,6 


3 . 


.25 


3 . 


.38 


2 . 


,7 


3 . 


.51 


3 . 


, 65 


2 . 


,8 


3 . 


.78 


3 . 


.92 


2 . 


,9 


4. 


.06 


4 . 


.21 


3. 


,0 


4. 


.35 


4 . 


. 5 


3. 


, 1 


4. 


.65 


4. 


.81 


3. 


,2 


4. 


.96 


5 . 


, 12 


3. 


,3 


5 . 


.28 


5 . 


.45 
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3.8 



3 . 


, 4 


5 . 


61 


5.78 


3. 


. 5 


5 . 


95 


6 . 13 


i 

-i 


\S 


6 . 
6 . 


3 

66 


6 . 48 
6 . 85 




, 8 


7 . 


03 


7 . 22 


3 , 


, 9 


7 . 


41 


7 . 61 


4 , 


, 0 


7 . 


8 


8 . 0 


4 , 


, i 


8 . 


2 


8 . 41 


4 


. 2 


8 . 


61 


8 . 82 


4 


. 3 


9 . 


03 


9 .25 


4 


. 4 


9 . 


46 


9 .68 


4 


. 5 


9 . 


9 


10 . 13 


4 


. 6 


10 


.35 


10 . 58 


4 


. 7 


10 


. 81 


11 . 04 


4 


. 8 


11 


.28 


11 . 52 


4 


.9 


11 
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5 


. 0 


12 


.25 
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5 , 


. 1 


12 


. 75 


13 . 0 


5 


. 2 


13 


.26 
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. 3 


13 


.78 
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5 


. 4 


14 
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5 
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14 


. 85 
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5 


. 6 


15 
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15 . 68 


5 


. 7 


15 
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5 
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16 
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17 


17 . 4 
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. 0 


17 


. 7 
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. l 


18 


. 3 
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. 2 


18 


. 91 
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6 , 


. 3 


19 
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20 


. 16 
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20 
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21 . 12 


6 , 
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21 
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22 
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22 


.78 
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23 
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7 , 
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24 
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24 
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7 , 
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25 
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26 
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27 
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27 


. 75 
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7. 


,6 


28 
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7. 


,7 


29 
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7. 


.8 


30 


.03 


30.42 


7. 


,9 


30 


.81 


31.2 


8. 


,0 


31 


. 6 


32.0 


8. 


, 1 


32 


.4 


32.8 


8. 


,2 


33 


.21 


33.62 


8. 


,3 


34 


.03 


34.44 


8. 


,4 


34 


.86 


35.28 
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8. 


, 5 


35. 


,7 


36. 


, 12 




,6 


36. 


. 55 


36. 


,98 


ll 
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,84 


1 
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.28 
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,72 
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,9 
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,6 


9. 


,0 
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,5 
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9. 


,2 
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9, 


.3 


42 
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9, 


.4 


43 
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, 18 


9, 


. 5 


44 
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45. 


, 12 


9, 


.6 


45 


. 6 


46. 


,08 


9, 


.7 


46 


.56 


47 . 


,04 


9, 


.8 


47 
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48. 


,02 


9, 


.9 


48 


.51 


49. 


.0 



So there you have it — Euler's method looks pretty accurate for your differen- 
tial equation's solution. Atx = 9.9, it's off only by 1% (49.00 - 48.51). Not bad. 
Tip: You can get even better accuracy by using smaller step sizes. 




You have to be careful when it comes to step size. If you have a really steep 
slope, you have to use a truly tiny step size to get the most accurate results. 



Defi/ing into difference Equations 

Euler's method, which is discussed in the previous section, brings up an 
interesting topic: difference equations. That's correct, you read right — 
"difference" equations. I know what you're thinking: An explanation is in 
order! Allow me to start at the beginning. Derivatives are built to work like 
this, where Ax — > 0 and y = f(x~)'- 



dy ,. f(x- 
-4- = hm — — 

OX 



Ax) - f(x) 



Ax 




However, sometimes, you don't want Ax to go to zero. In other words, some- 
times it just makes sense to keep the step size, Ax, discrete and nonzero. For 
example, you can set up a differential equation to calculate the interest you 
pay on a loan, but because Ax — > 0, the differential equation calculates the 
interest as if it were compounded continuously. But what if the interest is 
actually compounded monthly or annually? In that case, you should use Ax = 
1 month or 1 year, not Ax — > 0. 

When Ax doesn't go to zero, you have a difference equation, not a differential 
equation. I take some time to look at difference equations in the following 
sections. 
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ethod is a good example of a difference equation, because every y 
>ends on the previous y value: 



JVi = y n + f(x n , y„) h 

Here's how it looks written as a difference equation, where the value y ntl is 
some function of y n : 

y n *i = y„) 

Note: This is the kind of equation you'd use if interest was compounded 
annually in a savings account instead of continuously In that case, the future 
value of the savings account, y nfU depends on the current value, y„. 

Just as with differential equations, you can apply some terminology to differ- 
ence equations. In particular, the previous equation is a first order difference 
equation. Why? Because it depends on y„, not on earlier terms (y„. u y„. 2 , and 
so on). The equation is linear if f(n, y„) is linear in y n . If f(n, y„) isn't linear in y„, 
the equation is nonlinear. 

You can also have initial conditions for difference equations, such as the first 
value being set to a constant: 



y 0 = c 



Iterative solutions 



Because a difference equation is defined using successive terms: 

)Vi = f(p, y„) 
the solution is all the terms y 0 , y u y 2 ■ ■ • >W- 

To make solving these kinds of equations a little more manageable, assume 
that the function f\n the original equation only depends on y„, not on n itself, 
so you get: 

y„*i = f(y n ) 



So: 



yi = f(yo) 
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f(yd 

which means that: 





y 2 = f(yO = KKyd) 

This equation is sometimes written as: 

y 2 = /(yd = Wyd) = ^Oo) 

which is often called the second iterate of the difference equation's solution, 
written as f 2 (y 0 ~)- 

Here's the third iterate: 

y 3 = m = TO» = WOO)) 

The third iterate can also be written using the f () notation, like this: 

y 3 = /(yd = Wyd) = WCfo))) = f 3 (yd 
As long as y ml = f(y„), you can write the nth iterate as: 

y n = /"(yo) 



Equilibrium solutions 



It's often important to know what happens as n — > <x>. Does the series converge? 
Does it diverge? The answer tells you whether you have a viable solution. 

Sometimes, all they„ have the same value. In this case, the solution is said to 
be an equilibrium solution. The series converges to that equilibrium solution. 
So, every term is the same: 

y n = /"(yo) 

and: 

y„ = /(y„) 

I introduce some examples in the following sections. 
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Working without a constant 

Tojbetter understand equilibrium solutions, say, for example, that you have 
a bank that pays an interest rate, annually. The amount of money 
in year, n + 1, is written like so: 



y ntl = (i + o y n 

The solution of this difference equation is easy, because i is constant. Each 
year's savings is simply (1 + /) multiplied by the previous year's savings. So 
your equation looks like this: 

y„ = (i + O n yo 

This means that the limiting value as n — > oo depends on i. 
For instance, if i is less than 0, you get: 
lim y = 0 

n — co 

If i is equal to 0, you get: 

lim y„ = y 0 
Otherwise, you get: 

lim y„ = nonexistent 

n — oo 

That is to say, the equilibrium solution is i = 0. 
Working With a constant 

Just for kicks, change the circumstances from the previous section. Say that 
you increase your savings each year by adding a constant value, c. Your equa- 
tion would now look like this: 

y ml = (1 + o y n + c 

The solution to this difference equation is: 

y n = a + o>o + a + a + o + (i + o 2 + (i + o nA y 

If i isn't equal to 0, you can write the equation as: 

/, -x" (1 + 0"- 1 
y„=(l + i) y 0 +- r c 



Chapter 4: Exploring Exact First Order Differential Equations and Euler's Method 



For example, if you started with y 0 = $1,000 and i = 5%, and you add $1,000 a 
year for 10 years, you'd end up with an equation that looks like this: 



(1 + 0V.+ (1 + ? 1 c= 1-62(1,000) + 1=^1 (1,000) 



or: 



y= 1.62(1,000) + L6 lL 1 (1,000) = 1,620 + 12,400 = $14,020 



.05 

Not a bad return! 
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Part II 



purveying Second 
and Higher Order 
Differential 
Equations 



The 5 th Wave 



By Rich Tennant 




"We're both mathematicians, Sheldon, so let we 
explain it this viatj. Where r denotes the ordinate 
o£ our relationship at the time, i, above the point 
X, -where b denotes boring, o denotes over, m 
denotes moving on...are you starting to get 
any o£ this?" 
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In this part . . . 

/t's time to up the ante with second order — and 
higher — differential equations. A second order differ- 
ential equation is one that involves a second derivative; 
higher order equations involve three or more. 

In this part, you discover that there are dazzling new tech- 
niques to bring to bear with second and higher order 
equations, such as the popular method of undetermined 
coefficients and variation of parameters. Get set to exer- 
cise your brain! 




Chapter 5 



xamining Second Order 
Linear Homogeneous 
Differential Equations 



In This Chapter 

Focusing on the fundamentals of second order linear differential equations 

Getting a grip on constant coefficients 

Exploring characteristic equations 

Taking a crack at reduction of order 

Understanding the Wronskian and other cool theorems 



■ n Part I, I tell you what you need to know about a variety of first order dif- 
«C ferential equations. Now you're striking out into uncharted territory — 
second order differential equations. These kinds of equations are based heav- 
ily in physics — in wave motion, electromagnetic circuits, heat conduction, 
and so on. They're also fun and interesting. In this chapter, I walk you through 
the fundamentals of second order linear homogeneous differential equations, 
with a few useful tips and theorems thrown in along the way. 



To better understand second order differential equations, first take a look at 
the following equation: 




The 



Basics 
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As you can see, this equation has a second derivative, which makes it a 
second order differential equation. But you know what? That's not quite good 
: f(x, y) is okay for first order differential equations, but it isn't 
for second order ones because the function /'may also depend 
on dy/dx. So the following is the general form of a second order differential 
equation: 



second oraer 

^NuiLugWThe/ 
Vjbp\^I>ugh : 



dx 2 



f x,y, 



dy 
dx 



In the following sections, I introduce several important types of second order 
differential equations, including linear equations and homogeneous equations. 



In this chapter, I focus on the second order linear homogeneous differential 
equation (try saying that ten times fast!); if you can solve the homogeneous 
form of a differential equation, you can always solve the same differential 
equation as a nonhomogeneous differential equation (or at least give the solu- 
tion in integral form). In other words, finding the solution to the homogeneous 
differential equation is the fundamental part of solving second order differen- 
tial equations. (I show you how to solve second order linear nonhomogeneous 
differential equations in Chapter 6. As I note there, solving nonhomogeneous 
equations usually involves solving the corresponding homogeneous equation 
as well.) 



Linear equations 

I restrict this chapter to second order linear differential equations that have 
the following form: 

y" + p(x)y' + q(x~)y = g(pc) 

where: 

. d 2 y 
y= Hx" 

and: 



However, a typical second order linear equation is sometimes written as the 
following (who says that mathematicians don't like to mix things up a bit?): 

P(x)y" + Q(x)y' + R(x)y = G(x) 
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where P(pc), Q(x~), R(x), and G(x) are functions. The transition between the 
original equation and the alternate is easy. Check it out: 



Q(x) R(x) G(x) 



P(x) HK > P(x) SK > P(x) 





In this chapter, I show you only how to solve the typical second order linear 
equation for regions where p(x), q(x), and g(pc) are continuous functions, mean- 
ing that their values don't make discontinuous jumps. I also usually provide 
initial conditions as well, such as: 

y(xo) = y 0 

But that condition isn't enough to specify the solution of a second order 
linear differential equation. You also need to specify the value of y'(x<d- That 
value is usually something like this: 

y'Qco) =y'o 

Second order differential equations that aren't in the form of y" + p(x~)y' + 
q(x~)y = g(x) are called nonlinear. 



Homogeneous equations 

The equation y" + p(x)y' + q(x)y = g(x) is referred to as homogeneous if g(x) = 
0; that is, the equation is of the following form: 

y" + p(pc)y' + q(x~)y = 0 

Alternately, using the P(x), Q(x), R(x), G(x) terminology from the previous 
section, a homogeneous equation can be written as: 

P(x) y" + Q(x)y' + R(x)y = 0 

If second order linear differential equations can't be put into either of these 
forms, the equation is said to be nonhomogeneous. To find out how to solve 
linear nonhomogeneous differential equations, check out Chapter 6. 
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You may think that second order linear homogeneous differential equations 
are intimidating. But they really aren't, if you know some fundamentals. 

The best place to start solving second order differential equations is with 
equations where P(pc), Q(x), and R(pc) are constants, a, b, and c. So, for exam- 
ple, you get this equation when you include the constants: 

a y" + by' + cy = 0 

Okay, so you've narrowed things down. Now you're talking about second 
order linear homogeneous differential equations with constant coefficients. 
Despite the hairy name, these equations are pretty easy to solve. In fact, you 
can always solve an equation of this type using some elementary solutions 
and initial conditions. Take a look at the examples in the following sections. 



Elementary solutions 

To get you up to speed, I begin with this typical equation: 

y"-y = o 

Yes, this qualifies as a second order linear homogeneous differential equation. 
Why? Just figure that a = 1, b = 0, and c = -1. There you have it. 

To solve this differential equation, you need a solution y = f(pc) whose second 
derivative is the same as f(pc) itself, because subtracting the f(x) from f"(pc) 
gives you 0. 

You can probably think of one such solution: y = e x . Substituting y = e x into the 
equation gives you this: 

e x -e x = Q 

As you can see, y = e x is indeed a solution. 

In fact, y = Cie x (where is a constant) is also a solution, because y" still 
equals c x e x , which means that substituting y = c x e x into the original equation 
gives you: 



c x e x - c x e x = 0 
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So y = c x e x is also a solution. In fact, that solution is more general than just 
y = e x , because y = c x e x represents an infinite number of solutions, depending 
^yjj^e^^Iue of c x . 

You can go further still by noting that y = e~ x is also a solution, because: 

y"-y = e-*-e x = 0 



Again, note that if y = e x is a solution, then y = c 2 e x (where c 2 is a constant) is 
also a solution because: 



y"-y = c 2 e x -c 2 e x = Q 



And here's the fun part: If y = c x e x and y = c 2 e x are both solutions, then the 
sum of these two must also be a solution: 




y = c l e +c 2 e 

In other words, if y = f x (x~) and y = f 2 (pc) are solutions to a second order linear 
homogeneous differential equation, then: 

y = fiQc) + f 2 (x) 

is also a solution. 



Initial conditions 

In this section, I give you a look at some initial conditions to fit with the 
solutions from the previous section. For instance, say that you have these 
conditions: 



y(0) = 9 

and 



y'(0) = -1 

To meet these initial conditions, you can use the form of the solution y = c x e x + 
c 2 e x , which means thaty' = c x e? - c 2 e x . Using the initial conditions, you get: 

y(0) = Cie x + c 2 e x = c x + c 2 = 9 
y'(G) = c x e x - c 2 e x = c x - c 2 = -1 
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So you get these two equations: 
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These are two equations in two unknowns. To solve them, write c, + c 2 = 9 in 
this form: 

c 2 = 9 - Cj 

Now substitute this expression for c 2 into Cj - c 2 = -1, which gives you this 
equation: 

Ci - 9 + Cj = -1 

or: 

2c, = 8 

So 

C = 4 

Substituting the preceding value of c t into c t + c 2 = 9 gives you: 



Ci + c 2 = 4 + c 2 = 9 



or: 



c 2 = 5 

These values of Cj and c 2 give you the following solution: 

y = 4e x + 5e~ A ' 

That was simple enough, and you can generalize it as the solution to any linear 
homogeneous second order differential equation with constant coefficients. 

Checking Out Characteristic Equations 

Here's the general second order linear homogeneous equation, where a, b, 
and c are constants: 

a y" + by' + cy = 0 
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The solution of this equation is of the form y = e rx , where r isn't yet determined. 
Plugging y = e rx into the equation gives you: 



bre" 



0 




Dividing by e rx (which is always nonzero) gives you: 
ar 2 + br + c = 0 

This equation is called the characteristic equation for ay" + by' + cy = 0, and it's 
a quadratic equation. If the roots of the characteristic equation are r } and r 2 , 
the general solution of ay" + by' + cy = 0 is: 

y= c l e r '*+ c 2 e' lX 

Earlier in this chapter, I treat this equation as one solution of ay" + by' + cy = 
0. But the truth is that it's the unique solution, as is indicated by a theorem 
later in this chapter (see the later section "Putting Everything Together with 
Some Handy Theorems"). Because ar 2 + br + c = 0 is a quadratic equation, the 
following are three possibilities for r x and r 2 : 

r x and r 2 are real and distinct 

r x and r 2 are complex numbers (complex conjugates of each other) 
r\ = r 2 , where r t and r 2 are real 

You can take a look at these cases in the following sections. 



Real and distinct roots 




When it comes to characteristic equations, one possibility is that r x and r 2 are 
real, and not equal to each other. I explain the basics of understanding this 
concept and provide a clarifying example in the following sections. 

The basics 

When solving a general problem, where: 

y(xo) = y 0 



and: 



y'(x 0 )=y' 0 
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you get the following: 
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_c,e 1 ° + c,e ; 

and 

y' 0 =c 1 r 1 e r ' Jf »+c 2 r 1 e r!jt » 
Then you can solve for Ci and c 2 in these equations, which gives you: 



-i r,-r, 



and: 



L 2 r,-r 2 e 



/4n example 

How about an example to bring the concept of real and distinct roots into 
focus? Try this second order linear homogeneous differential equation: 



y"+5y' + 6y=0 
with the initial condition that: 
y(0) = 16 

and: 

y'(0)=-38 



To solve, make the assumption that the solution is of the form y = ce rx . 
Substituting that equation into y" + 5y' + 6y = 0 gives you: 

cr^ + 5cre" + 6ce™ = 0 

Next you divide by ce' x to get: 

r 2 + 5r + 6 = 0 

which is the characteristic equation fory" + 5y' + 6y = 0. You can also write 
this equation as: 



(r+2)(r+3) = 0 
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and 



and 

r 2 = -3 

which means that the solution to y" + 5y' + 6y = 0 is: 

y = de + c 2 e 

where d and c 2 are determined by the initial conditions: 

y(0) = 16 

and: 

y'(0) = -38 

Substituting the initial conditions into your solution gives you these equations: 
y(0) = d + c 2 = 16 



and: 

y'(0) = -2a - 3c 2 = -38 



From the first equation, you can see that c 2 = 16 - c u and substituting that 
into the second equation gives you: 

-2d - 3c 2 = -2d - 48 + 3cj = c, - 48 = -38 

or: 



d = 10 

Substituting this value of d into y(0) = d + c 2 = 16 gives you: 

d + c 2 = 10 + c 2 = 16 
So that means: 

c 2 = 6 
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Now you've found c x and c 2 , which means that the general solution to y " + 5y ' + 
6y = 0 is: 



Oe" 2 * + 6e 3x 

You can see this solution graphed in Figure 5-1. 



Figure 5-1: 

The solution 
to an 
equation 
with real 
and distinct 
roots. 





Complex roots 



Besides real and distinct roots (see the previous section), another possibility, 
when it comes to characteristic equations, is having complex roots. In this 
case, the quadratic formula yields two complex numbers. I explain the basics 
of this concept and walk you through an example in the following sections. 

The basics 

Check out the following quadratic equation: 



-b±Jb 2 -4ac 
r= 2a 

The discriminant, b L - 4ac, is negative, which means that you're taking the 
square root of a negative number, so you get complex numbers. In particular, 
the imaginary part of the two roots varies by their sign (+ or -), as shown 
by the example equation. 
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In other words, the roots are of the following forms: 
i\i 

and 

r 2 = X - i\i 

where A, and |i are both real numbers, and i is the square root of -1. 

As you can see, the characteristic equation has complex roots. What does 
that mean for the solution to the differential equation? As you find out earlier 
in this chapter, the solutions to the differential equation are: 

y,=C'* 

and 

y 2 =e v 

So: 



yi = e- 
and: 

y 2 = e 01 -* 0 * 



Now you have to deal with complex numbers as exponents of e. You may be 
familiar with the following handy equations: 



and: 



You're making progress! You have now removed /' from the exponent. Putting 
these two equations to work gives you these forms for the solutions, y 1 and y 2 - 

y x = e {X * m = e^(cos [vc + i sin ux) 

and: 

y 2 = e ^"^ x = e ^(cos \xx-i sin \xx) 
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However, you still have that pesky factor of i; and you want to get rid of it. 
Why? The general differential equation that y x and y 2 are solutions of only has 
icients: 



ay" + by' + cy = 0 

4sy ®\ Here's the key: You could get rid of those factors of i if you could just divide 
them out. After all, i is just a constant. For instance, if you had the solution in 
a form like this: 




y„ = i e^cos ux 

you could replace i with an arbitrary constant of integration, c, which would 
look like this: 

y n = c e^cos ux 

Now try adding and subtracting y x and y 2 . As you recall from the earlier sec- 
tion "Elementary solutions," if two functions are a solution to a linear differen- 
tial equation, the sum and difference of those functions are also solutions. So 
you can introduce the new solutions m(x) and n(x), the sum and difference of 
y and y 2 : 

m(x) = yi(x) + y 2 (x) 

and: 

n(x) =y,(x)-y 2 (x) 
First, calculating m(x) gives you the following equation: 

= yiQO + y?(X) = e^(cos ux + i sin ux) + e^(cos ux - i sin ux) 
which you can convert to: 

m(x) = yi(x) + y 2 (x) = 2 e^cos ux 

Your solution now looks fine — there's no pesky i lurking around. Now how 
about calculating n(x)? Here's what that looks like: 

n(x) = y^x) - y 2 (x) = e^(cos ux + /' sin ux) - e^(cos ux - sin ux) 

which works out to: 

"( x ) = yiOO _ y2( x ) = 2i sin ux 
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Your solution is looking even better, because now m(x) and n(x) have the fol- 
lowing forms: 



Ci e^cos ux 




and: 

n(x) = c 2 sin \ix 

Yes, it's true that n(x) as written is multiplied by /': 2i sin ux. But that's the 
beauty of the whole thing: 2i is just a constant, so it can be replaced by c 2 . 
And that substitution gets rid of the pesky i. 

So, finally, you can write the solution as: 

y(x) = 771 (x) + t?(x) 

or: 

y(x) = c, cos |ix + c 2 sin ux 

where you get X and \i from the roots of the differential equation's character- 
istic equation: 



ar 2 + br + c = 0 
where the roots are: 
r x = X + i\i 

and 

r 2 = X - i[i 
An example 

If you feel like you've grasped the basics of complex roots, take a look at an 
example. Try solving this differential equation: 

2y" + 2y' + y = 0 

where: 

y(0) = i 

and 



y'(0) = 1 
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You probably already have a good idea what to do here. You simply need to 
find the characteristic equation and then the roots of that equation. Here's 
cteristic equation: 



2r + 1 = 0 



You can find the roots of this characteristic equation by using the quadratic 
equation from the previous section. Your work should give you these roots: 



-2±/4-8 



4 

This equation works out to be: 

r = -K + QA)i 
So the two roots are: 
r x = -A + QA)i 

and: 

r 2 = -K - QA)i 
Because the two roots are of the form: 
r x = X + i\i 

and 

r 2 = X- 

then: 

X=-V2 

and: 

U. = M 
So the solution is: 

y(pc) = Cj e~ xj2 cos "A + c 2 e~ x ' 2 sin Vi 
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To find Ci and c 2 , you simply have to apply the initial conditions (substituting 
in for y(0) and y'(0)), which means that: 

c, = l 

and: 



y'(0) = J4, + He = 1 
Substituting c x = 1 gives you: 

y'(0) = M + Mc = 1 
So c 2 = 1. That makes the general solution to 2y" + 2y' + y = 0: 

y(x) = e xl2 cos ^ + e x ' 2 sin ^ 

And that's it — no imaginary terms involved. Cool. You can see a graph of 
this solution in Figure 5-2. 



Figure 5-2: 

The solution 
to an 
equation 
with 
complex 
roots. 



i r~ 

6 x 7 
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vious sections, I cover the cases where the characteristic equation 
and distinct roots as well as complex roots. All that's left is the case 
where the characteristic equation has two real roots that are identical to each 
other. You get the fundamentals and an example in the following sections. 



^jjj»BEtf The basics 

*/". ..¥N When the roots of a characteristic equation are identical, the discriminant of 
the quadratic equation, b 2 - Aac, equals zero, which means that: 

r x = -b/2a 

and 

r 2 = -b/2a 

«jjl\NG/ 

•^/^~~3<>\ However, now you have a problem. Why? Because second order differential 
equations are supposed to have two expressions in their solution. Because 
>"i = r 2 , you get this: 

y^c^ y 2 = c 2 e^ l2a 

These solutions differ only by a constant, so they aren't really different at all; 
you could write either y, + y 2 or yx - y 2 as: 

y = ce bxl2a 

So, as you can see, you really only have one solution in this case. How can you 
find another? Here's the traditional way of solving this issue: So far, you've 
been finding solutions to second order linear differential equations by assum- 
ing the solution is of the following form: 



y(x) = ce rx 

However, consider this: What if you replaced the constant with a function of x, 
m(x), instead? Doing so would let you handle more general second order linear 
differential equations. By doing this, you get: 

y(x) = m(x)e" 

In this case, r = -b/2a, so you get this form of the solution: 

y(x) = m(x)e' bx ' 2a 
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Differentiating the equation gives you: 
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m{x)e bxlla -^ i m{x)e 





You also need y "(x) to substitute into the differential equation. Doing so 
gives you: 

/(*) = m"(x)e- b ' /2a - ^m'(x)e-" xm, + -^m(x)e-" xl2a 
Substituting y(pc), y'Qc), and y"(x) into the following differential equation: 

ay" + by' + cy = 0 
gives you (after rearranging the terms): 

am"(x) + (b-b)m'(x) + ( [ ^-^+c)m(x) = 0 

So b - b = 0 in the second term, along with combining the fractions in the 
third term, gives you: 

am"(x) + [c-^m{x) = Q 

Here's the trick: Note that c - b 2 /4a is the discriminant of the characteristic 
equation, and in this case (the case of real identical roots), the discriminant 
equals zero. So you have: 

a m"(x) = 0 

or simply, dividing by a: 

m"(x) = 0 

Wow, that looks pretty easy after all. After integrating, you get this final form 
for m(x): 

m(x) = dtf + d 2 

where d x and d 2 are constants. 

Because the second solution you've been looking for is y2(x) = m(pc)e rx = 
d x xe rx + d 2 e rx , here's the general solution of the differential equation in the 
case where the characteristic equation's roots are real and identical: 

y(x) = c l xe bxl2a + c 2 e' bxl2a 

where and c 2 are constants. 
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This trick, it turns out, can often be used to find a second solution to a 
second order linear homogeneous differential equation if you already know 
fion. In fact, trying a solution of the form y(pc) = m(x)f(pc) is so useful 
>s been given a name: the method of reduction of order. I discuss this 
method in more detail later in this chapter. 
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An example 

Want to see an example so that the identical real root concept can really take 
hold? Take a look at this differential equation: 

y"+2y' +y = 0 

where: 

y(0) = 1 

and: 

y'(0) = i 

The characteristic equation is: 

r 2 + 2r + 1 = 0 
You can factor this equation into: 

(r + 1) (r + 1) = 0 

So the roots of the characteristic equation are identical, -1 and -1. 
Now the solution is of the following form: 

y(x) = c lX e- bxlZa + c 2 e- bxl2a 

To figure out Ci and c 2 , use the initial conditions. Substituting into the equa- 
tion gives you: 

y(0) = c 2 = l 

Differentiating the y(x) equation gives you y'(x); you also can substitute c 2 = 1 
to get: 

/(*) = Cl e- bxl2 °- ^xe- bx,2 °- J^e- bxl2 ° 
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From the initial conditions, y'(0) equals: 
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So c, = 2, giving you 



, giving you the following general solution: 

y(x) = 2xe x + e* 

And that's that. You can find a graph of this solution in Figure 5-3. 



Figure 5-3: 

The solution 
to an 
equation 
with 
identical 
real roots. 




Getting a Second Solution 
by Reduction of Order 



If you know one solution to a second order differential equation, you can get 
a first order differential equation for the second solution — or rather, for the 
derivative of the second solution, which you can then integrate to get the 
actual second solution. That's where the term reduction of order comes from. 
The method is very cool, as you find out in the following sections. 
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Seeing how reduction of order Works 

t fc2he reduction of order method? Basically it says that if you already 
nw evolution, yi(x), to a differential equation of this form: 

y" + p(pc)y' + q(x) = 0 

you can substitute the following expression into the equation to search for a 
second solution: 

y(x) = m(x)yi(x) 

Note that the original equation isn't restricted to differential equations with 
constant coefficients. However, it is homogeneous (in other words, it equals 
zero). 

Differentiating y(pc) = m{x)yi(x) with respect to x gives you: 

y'(x) = m'(x)yi(x) + m(x)yi'(x) 
You also need the second derivative of y(x) = mQx^y^x), which looks like this: 

y"(x) = m"Qc)yi(x) + m'Qctyi'Qc) + m'(x}yt'Qe) + m(x)y x \x) 
The middle two terms are the same, so the equation becomes: 

y"(x) = rnXxtyiQc) + 2m'(pc)y 1 '(x) + m(x)y x "(x) 

Putting y'(x) and y"(x) into y " + p(x)y' + q(x) = 0 gives you the following 
equation: 

y x m " + (2y x ' + pyjm ' + (y x " + py x ' + qyj = 0 

I bet you recognize the expression in the second set of parentheses here. And 
guess what? That's the point! That expression is y x " + py x ' + qy x , which is just 
yi substituted into the original differential equation. But y x is a solution of 
that homogeneous differential equation, so the expression in parentheses 
equals 0! 

So you end up with this equation: 

yim " + (2y, ' + py^m ' = 0 
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It doesn't look pretty, but examine what you have here: This is actually a first 
order differential equation in m'(x). If you substitute n(x) = m'Qc) into the 
, you get this: 



y,n '(x) + (2yi ' + pydnQc) = 0 

This final equation is a first order differential equation in n(x), and it can 
often be solved as a first order linear differential equation or as a separable 
differential equation (see Chapters 2 and 3 for more about these types of 
equations). 



Trying out an example 

In this section, you can see reduction of order at work in an example. Take a 
look at this second order differential equation: 

2x 2 y" + xy' -y = 0 

How do you tackle this one? I walk you through the process in the following 
sections. 

The first solution 

In the equation 2x 2 y" + xy' -y = 0, note how each successive derivative y' and 
y" is multiplied by a new power of x. This suggests that differentiating a solu- 
tion of this differential equation generates a new power of x in the denomina- 
tor (and that the x and x 2 cancel out). So try a first solution of the form: 

yi = Vx" 

Substituting this solution into the equation gives you: 

2x 2 n(n+\yx nt2 -xn/x n+1 - 1/x" = 0 
By cancelling 1/x", you get: 

2n(n+l)-n- \ = 0 

or: 



2n 2 - n - 1 = 0 
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The quadratic equation gives you these roots: 
1 ±3 



Taking the root r = 1, you see that: 

yi = Vx 

is a solution of 2x 2 y" + xy' -y = 0. (You can take a look at the other root, r = -A, 
in the later section "A little shortcut.") 

The second solution 

In the previous section, you find the first solution, y t = l/x. Now you use the 
reduction of order method to find a second solution. This means that you're 
now looking for a solution of the following form: 

y 2 = m(x)/x 
The first derivative of this solution is: 

y-i = m '(x)/x - m(x)/x 2 
The second derivative is: 

y 2 " = m"(x)/x - 2m'(x)lx 2 + 2m(x)/x 3 
Substituting y' and y" into 2x 2 y" + xy' -y = 0 gives you (after the algebra settles): 

2xm" - m' = 0 

To make this equation a little easier to work with, set m'(x) = n(x), which 
gives you this: 

2x^ = n 
ax 



Separating the variables results in the following equation: 

dn dx 
n 2x 

or: 

ln(n) = ln(x)/2 
Exponentiating both sides of the equation gives you: 

n(x) = kx 1 ' 2 
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where k is a constant. Because n(x) = m'(x), you know that: 

ex 3 ' 2 + d 
where c and d are constants. 
This solves for m(x). Now because, by y 2 = m(pc)/x: 

y 2 = m(x) y x = m(x)/x 
you know that: 

y 2 = Cix 1 ' 2 + c 2 /x 

Note that the second term here can be absorbed together with y 1 (which is 
1/x). So the complete solution is (I've absorbed the constants together as 
needed): 

y = yi+y 2 = cix 1/2 + c 2 /x 
A tittle shortcut 

You may have noticed that in the previous example, you didn't actually need 
to use reduction of order. I'll show you what I mean. The differential equation 
you were solving looked like this: 

2x l y" + xy' -y = 0 

You guessed that the solution was of the following form: 

y=Vx" 

Substituting this into the differential equation gave you: 
2n 2 - n - 1 = 0 

which has these roots: 

1 ±3 
4 

So the roots are 1 and -A, which means that you did in fact have two solu- 
tions already: 

yi = ci/x 

and: 

y 2 - c 2 x 1/2 
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Puttinq Everything Together With 
P&Q&Hdkdy Theorems 

A couple of formal theorems, which I explain in the following sections, lock 
down exactly how to find the general solutions to second order linear homo- 
geneous differential equations and formalize the information from earlier 
sections. 



Superposition 



"v \ ' I' st ar t off with the theorem on superposition of solutions, which formally 
says this: 

If you have the second order linear homogeneous differential equation: 



y" + p(x)y' + q(x) = 0 



and have two solutions, y,(x} and y 2 (.v), then any linear combinations of 
these solutions: 



y = c,y, + c 2 y 2 



where c x and c 2 are constants, is also a solution of the differential equation. 

In plain English, this theorem simply says that if you have two solutions to a 
second order linear differential equation, a linear combination of those two 
solutions is also a solution. You actually use this theorem throughout the first 
part of this chapter as you solve second order linear homogeneous differen- 
tial equations for two solutions, yj and y 2 , and give the general solution as a 
linear combination of the two. 

Here's another example; say that you have the following second order linear 
differential equation: 

y"-y = o 

You can guess that the solution is of the form y = e" x and that substituting it in 
gives you: 

n 2 e nx -e nx = 0 



or: 



n 2 - 1 = 0 
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So the two solutions you've worked out are: 

yi = c x e x 

and 

y-i = c 2 e~ x 

According to this theorem, the following linear superposition of these solu- 
tions is also a solution: 

y = c x e x + c 2 e x 

You can verify your solution by substituting it into the original equation: 

y"-y = c x e x + c 2 e' x - {c x e x + c 2 e _jr ) = 0 



Linear independence 



Earlier in this chapter, you work problems to find the solutions y x and y 2 to 
second order linear homogeneous differential equations, but it turns out that 
there's a restriction on them — they have to be linearly independent. What, 
exactly, does that mean? 

If you have two functions, f(x) and g(x), they're linearly dependent in an inter- 
val lit for all x in / you can find two constants, c x and c 2 , such that this equa- 
tion is true: 

CifQc) + c 2 g{x) = 0 

In other words, f(x) just differs from g(x) by a constant. 

If the functions f and g aren't linearly dependent in the interval /, they're lin- 
early independent in the interval /. In other words, if it's impossible to find 
two constants such that the previous equation is true for f(x) and g(x) in the 
interval /, then f(x) and g(pc) are linearly independent in the interval /. 



Practically speaking, if one function isn't just a multiple of another function, 
the two are linearly independent. 
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Here's the formal theorem: 

; ve the second order linear homogeneous differential equation: 
y' + p(x)y' + q(x) = 0 



ooks v 



and have two linearly independent solutions, yi(x) and y 2 (pc), then any 
linear combinations of these solutions: 

y = c, Vi + c 2 y 2 

where Ci and c 2 are constants, is the general solution of the differential 
equation. Every solution of the differential equation can be expressed in 
the form of y = Ciy x + c 2 y 2 . 

In other words, you can't just use any two solutions, yj andy 2 , to a second 
order linear homogeneous differential equation. Instead, those two solutions 
have to be linearly independent so that a linear combination of them is a gen- 
eral solution of the differential equation. 

Clear as mud, right? Well, here's an example to wrap your brain around. Say 
that you have the following differential equation: 

y"+ 6y'+ 8y = 0 

What's the general solution of this equation? Well, guessing that the solutions 
are of the form y = e rx , you get the following equation by substituting the solu- 
tion into the differential equation: 

r 2 e rx + 6re rjc + 8e rx = 0 
The characteristic equation is: 

r 2 + 6r + 8 = 0 
which can be factored into: 

(r + 4) (r + 2) 

So the roots of the characteristic equation are -4 and -2, and your solutions 
are of the form: 



yi = c x e 



and 



yi = c 2 e 
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These solutions are linearly independent — they don't just differ by a multi- 
plicative constant — so by the theorem of linear independence, the general 
,to the differential equation has the following form: 



y = c x e * + c 2 e 2x 




The Wronskian 



You may have heard of the Wronskian, especially if you aspire to be a 
Differential Equations Wizard (and doesn't everyone?). But if you haven't 
heard of it, you're probably wondering what it is. Briefly put, the Wronskian 
is the determinant of an array of coefficients that lets you determine the 
linear independence of solutions to a differential equation. 



Okay, that was a mouthful. What does it mean in layman's terms? I explain 
what you need to know and provide some examples in the following sections. 

Arrays and determinants 

Say that you have a second order linear homogeneous differential equation 
with the following general solution: 

y = c x y x + c 2 y 2 

And assume that you have these initial conditions 



y(xo) = y 0 



and 

y'(Xo) =y' 0 

The initial conditions mean that the constants c 1 and c 2 have to satisfy these 
equations: 

y 0 = ciyi(x 0 ) + c 2 y 2 (x 0 ) 



and: 



y'o = Ciy'i(x 0 ) + c 2 y' 2 (x 0 ) 
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Solving this system of two equations for Cj and c 2 gives you: 

yoy , 2(^o)-y'o> , 2(^o) 



and: 



¥i{x 0 y 2\Xo)-y i(x 0 yi(x 0 



-y«y ,{x 0 )+y .y^,) 
y 1 (x 0 )y'Jx 0 )-y' l (x (l )y 2 (x ( , 



At some point in time, someone got the bright idea that this system looks like 
the division of two array determinants. As a refresher on determinants, say 
you have this array: 



a b 
c d 

In the example, the determinant is: 
a b 

■ ad- cb 

Using this notation, you can write the expressions for Ci and c 2 in determinant 
form: 





y» y 2 (*o) 






y'o y\(x 0 ) 




y 


t(x 0 ) y 2 (x 0 )\ 


y\(x 0 ) y' 2 (x 


•)| 



and: 



yi{x 0 
y'i(x 0 



y« 
y'o 



y x (x 0 ) y 2 (x 0 ) 
y\(x 0 ) y' 2 (x„) 



In order for q and c 2 to make sense in these expressions, the denominator 
must be nonzero, so: 



W- 



yi\x 0 ) y 2 (x 0 ) 
y\(x 0 ) y'Jx 0 ) 



--yi(xo)y' 2 (x 0 ) -y\(x 0 ) y 2 (x 0 ) + 0 



Here's the Wronskian (W) of the solutions y 1 and y 2 : 

W = yi(x 0 )y' 2 (xo) -yi '(*o)y2(xo) 
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Who was Wronski? 
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i/ronski (1778-1853) was a 
Polish philosopher. He studied and published in 
many fields, such as philosophy, math, and 
physics, and he also was an inventor and a 
lawyer. 

Despite deep flashes of insight into math and 
some other fields, Wronski spent much of his life 



pursuing ultimately unsuccessful topics, such as 
perpetual motion machines. Unfortunately, during 
his lifetime, his work was largely ridiculed and 
ignored. However, since his death, people have 
come to unearth significant nuggets of thought 
from his writings. 



^piSr^ You may also see the Wronskian referred to as the Wronskian determinant. It's 
;^Y f ** r \ named for a Polish mathematician, Josef Maria Hoene-Wronski (and you 
thought mathematicians had bland names). Check out the nearby sidebar 
"Who was Wronski?" for more info. 

The formal theorem 

The Wronskian is a measure of linear independence. Consider this, for exam- 
ple: If you have two solutions, y x and y 2 , and their Wronskian is nonzero, then 
those solutions are linearly independent. And that, my friend, means that 
every solution to the differential equation is a linear combination of those 
two solutions. 



And that brings me to a formal theorem: 

If you have the second order linear homogeneous differential equation: 

y' + p(x)y' + q(x) = 0 

and have two solutions, yiQc) and y 2 (.x), where their Wronskian is nonzero 
at a point x 0 , then any linear combinations of these solutions: 



y = c,y, + c 2 y> 

where Ci and c 2 are constants, is the general solution of the differential 
equation. Every solution of the differential equation can be expressed in 
the form of y = Ciyi + c 2 y 2 . 

Here's the gist of this formal theorem: If the Wronskian of your two solutions 
is nonzero at a point x 0 , then a linear combination of those solutions contains 
every solution of the differential equation. In other words, if you have two 
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solutions, yi and y 2 , and their Wronskian is nonzero, then this is the general 
solution of the corresponding differential equation: 



iyi + c 2 y 2 

Note: The y x and y 2 form is what's called a fundamental solution to the differ- 
ential equation. 

Example 7 

How about some examples to get a hang of the Wronskian? Earlier in this 
chapter, you tackled this differential equation: 

y"+2y' +y = 0 
The characteristic equation is: 

r 2 + 2r + 1 = 0 
and you can factor that equation this way: 

(r+ l)(r+ 1) = 0 

which means that the roots of the differential equation are identical, -1 and 
-1. So the solution is of the following form: 

y{pc) = CiXe' x + c 2 e x 

Now take a look at the Wronskian, which looks like this: 

y»(*o) y 2 (x 0 ) 



y Ax 0 ) y 2 (x„ 



= y 1 (x 0 )y' 2 (x 0 )-/ 1 (x 0 )y 2 (x 0 ) 



W = 
Because: 

y, = dxe~ x 

and 

yi = c 2 e x 
the Wronskian equals: 

W = yi(x 0 )y' 2 (xo) -y x '(x^y 2 (x^ = -CiXe'" c 2 e* - fae* - dxe ^c^ 

or: 

W=-c l c 2 e 2x 
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And because the Wronskian is always nonzero, you don't even have to substi- 
tute x 0 in; yj and y 2 form a fundamental solution of the differential equation, as 
and c 2 are both nonzero. 



Example 2 

Here's another example. Say that you have two solutions, y x and y 2 , to a 
second order linear homogeneous differential equation such that: 



y,= e 



and 



y 2 =e> 

Your task now is to show that y x and y 2 form a fundamental solution to the dif- 
ferential equation if r x ^ r 2 . 

Time to check the Wronskian: 



y\x 0 ) y 2 {x 0 ) 
y\(x 0 ) y\(x 0 ] 



-yAx 0 \y Jx 0 )-y Ax 0 )y 2 (x 0 \ 



Because y x = e r * and y 2 = e r 2 x , the Wronskian equals: 

W=y 1 (x a )y\(x 0 ) -y\(x a )y 2 (x a ) = e'< x r 2 e r * x - 

or: 



r, e" 



Don't forget: You don't have to substitute x 0 into the Wronksian, because it's 
clearly nonzero everywhere as long as r x ^ r 2 . So y t and y 2 form a fundamental 
solution set of the differential equation. 

Because: 

y t =e r ' x 

and 

y 2 =e r ' x 

you can see that what the Wronskian is trying to say is that y x and y 2 are lin- 
early independent. In other words, you can't multiply y x by a constant so that 
it equals y 2 for all x in an interval, such as -2 < x < 2, as long as r x ± r 2 . 
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Example 3 

Hare's one final Wronskian example. Earlier in this chapter, you solve this dif- 
equation: 



■— ^ Hare s on 
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2x 2 y" + xy' -y = 0 
By guessing that the solution was of the following form: 

* = Vx" 

you came up with this characteristic equation: 

2n 2 - n - 1 = 0 
and found this solution: 

y = CiX y2 + c 2 /x 

Is this the general solution? You can find out by bringing the Wronskian to the 
rescue: 

W=y l (x 0 )y' 2 (x 0 ) -y\(x 0 )y 2 (x 0 )= -c,x v2 cjx 2 - ^x- ,,2 c 2 /x 

or: 



-1^2- 



c t c 2 
2 x 



So: 



:3 

If Ci and c 2 * 0, then because W=t 0 for x > 0, you can conclude that: 

y = c-iX 112 + c 2 /x 
is indeed the general solution. 
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Linear Nonhomogeneous 
Differential Equations 

In This Chapter 

Focusing on the facts of linear nonhomogeneous second order equations 

Mapping out the method of undetermined coefficients 

Perusing variation of parameters 

Applying nonhomogeneous equations to physics 

Chapter 5 is about second order linear homogeneous differential equa- 
tions of this form: 

y" + P(x)y' + q(x)y = 0 

This equation is homogeneous because it equals zero (and there's no term 
that only relies on x). In this chapter, however, you tackle differential equa- 
tions of the nonhomogeneous form: 

y" + p(pc)y' + q(x)y = g(pc) 

where g(pc) * 0. 

Exciting, isn't it? To start, I provide you with a theorem that gives you the 
power you need to solve these kinds of equations. After that, I describe some 
great techniques for working with these equations. I even throw in a few 
physics examples to show you how these equations apply to real life. 
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Luckily for mathematicians everywhere, a quick and easy theorem giving the 
general solution of a second order linear nonhomogeneous differential equa- 
tion exists. And this theorem is the one that you'll refer to over and over 
again in this chapter. In the following sections, I explain the theorem and how 
you can put it to work. 




Understanding an important theorem 

Without further ado, here's the theorem of the general solution of a second 
order linear nonhomogeneous differential equation: 

The general solution of the nonhomogeneous differential equation: 

y" + P(x)y' + q(x)y = g(x) 



is: 



y = CiM*) + c 2 y2(x) + y p (x) 



where CiyiQc) + c 2 y 2 (x) is the general solution of the corresponding homo- 
geneous differential equation: 

y" + p(x)y' + q(dy = o 

(for example, y, and y 2 are a fundamental set of solutions to the homoge- 
neous equation) and where y p (x^ is a specific solution to the nonhomoge- 
neous equation. 

This very important theorem basically says that to find the general solution 
to a nonhomogeneous differential equation, you need the sum of the general 
solution of the corresponding homogeneous differential equation added to a 
particular solution of the nonhomogeneous differential equation. A particular 
solution is any solution of the nonhomogeneous differential equation. Quite a 
mouthful isn't it? Not to worry; I explain how to use this theorem in the next 
section. 
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Putting the theorem to Work 

1 to follow these steps to find the general solution of a second order 
nhomogeneous equation: 

1. Find the corresponding homogeneous differential equation by setting 
gf(v)toO. 

2. Find the general solution, y = c t yi(pc) + c l y 2 Qc), of the corresponding 
homogeneous differential equation. 

This solution is referred to as y h . 

3. Find a single solution to the nonhomogeneous equation. 

This solution is sometimes referred to as the particular (or specific) 
solution, y p . 

4. The general solution of the nonhomogeneous differential equation is 
the sum oiy h +y p . 

To see these steps in action, take a look at this nonhomogeneous differential 
equation: 

y"-y--2y = e' x 

To solve this equation, start by getting the homogenous version of it, like this: 

y"-y'-2y = 0 

You can assume that the solution is of the form y = e rt . So, when you substi- 
tute that into the differential equation, you get the following characteristic 
equation (see Chapter 5 for more details): 

r 2 -r-2 = 0 

You can then factor the characteristic equation this way: 
(r+ l)(r-2) = 0 

Now you can see that the roots, n and r 2 , of the characteristic equation are -1 
and 2, giving you: 

yi = er x 

and: 
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So, the general solution to the homogeneous differential equation is given by: 
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x e ~ + c 2 e 2x 



You're halfway there! Now you need a particular solution to the original non- 
homogeneous differential equation: 

y"-y'-2y = e ix 

Note that g(pc) has the form e 3x here, so you can assume that the particular 
solution has this form: 

y p (x)=Ae 3x 

In this case, A is an arbitrary coefficient. 

Substituting this form into the nonhomogeneous equation gives you: 
9Ae 3x -3Ae 3x -2Ae 3x = e 3x 

or: 

04 - 3A - 2A = 1 

So 

4/4 = 1 

and 

A = % 

The particular solution is: 

y,(*) = T 



Because the general solution to the nonhomogeneous equation is equal to 
the sum of the general solution of the corresponding homogeneous differen- 
tial equation and a particular solution of the nonhomogeneous differential 
equation, you get this equation as the general solution: 

y = y h + y P 

or: 



y= c 1 e~* + c 2 e 2 *+ e 



4 
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Are there any techniques that allow you to find particular solutions to non- 
homogeneous differential equations? Yes, there are! I'll start with the method 
of undetermined coefficients, which is actually a method you use earlier in 
this chapter (you just didn't know the fancy name there). 

You start by finding a particular solution to the nonhomogeneous differential 
equation: 

y" + p(x)y' + q(x)y = g(x) 

The method of undetermined coefficients notes that when you find a candidate 
solution, y, and plug it into the left-hand side of the equation, you end up with 
g(x~). Because g(x~) is only a function of x, you can often guess the form of 
y p (x), up to arbitrary coefficients, and then solve for those coefficients by 
plugging y p (x) into the differential equation. 

This method works because you're grappling only with g(pc) here, and the 
form of g(x) can often tell you what a particular solution looks like. For 
instance, if g(pc) is in the form of 



V e rx , try a particular solution of the form Ae rx , where A is a constant. 
Because derivatives of e" reproduce e rx , you have a good chance of find- 
ing a particular solution this way. 

V a polynomial of order n, try a polynomial of order n. For example, if 
g(x) = x 2 + 1, try a polynomial of the form Ax 2 + B. 

a combination of sines and cosines, sin our + cos fix, try a combination 
of sines and cosines with undetermined coefficients, A sin ax + B cos |3x. 
Then plug into the differential equation and solve for A and B. 



In the following sections, you take a look at some examples that put to work 
the method of undetermined coefficients, and then you solve actual differential 
equations using the theorem I explain earlier in this chapter. 



When is in the form of e r * 

You see the following equation in its entirety in the earlier section "Putting 
the theorem to work," but here's how to figure out the particular solution: 

y"-y'-2y = e 3x 
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From the form of the term on the right, g(x), you can guess that a particular 
solution, y p (x), has the form: 
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Ae 3x 

Substituting this into the differential equation gives you: 

9Ae 3x -3Ae 3x -2Ae 3x = e 3x 
Dropping e ix out of each term gives you: 
04 - 3/4 - 2A = 1 

So: 

44 = 1 

and 

A = l A 



The particular solution for the differential equation is: 

el 
4 



When is a polynomial of order n 

The example in this section points out how to deal with a particular solution 
in the form of a polynomial. Your mission, should you choose to accept it, is 
to find the general solution of the following nonhomogeneous equation: 

y"= 9X 2 + 2x- 1 

where: 

y(0) = i 

and 

y'(0) = 3 

The general solution to the homogeneous equation 

The homogeneous equation is simply: 



y" = o 
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And you can integrate to get this equation: 
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Integrating again gives you the general solution to the homogeneous differen- 
tial equation, y h : 

y h = dx + c 2 

The particular and general solutions to the nonhomogeneous equation 

To find the general solution to the nonhomogeneous equation, you need a 
particular solution, y p . The g(x~) term in the original equation is 9X 2 + 2x - 1, 
so you can assume that the particular solution has a similar form: 

y p = Ax 2 + Bx + C 

where A, B, and Care constant coefficients that you have to determine. But 
here's the issue: The supposed form of y p has terms in common with y h , the 
general solution of the homogenous equation: 

y h = dx + c 2 

y p = Ax 2 + Bx + C 

Both of these have an x term and a constant term. When y h and y p have terms 
in common — differing only by a multiplicative constant — that isn't good, 
because those are really part of the same solution. When you add y h and y p 
together, you get this: 

y = yh + y P = Ax 2 + (ct + B)x +(c 2 + q 

which can be rewritten: 

y = yh + y P = Ax 2 + cx + d 

where c and d are constants. As you can see, the terms Bx + C in y p really 
don't add anything. 

The way to handle this issue is to multiply y p by successive powers of x until 
you don't have any terms of the same power as in y h . For example, multiply y p 
by x to get: 



y p = Ax 3 + Bx 2 + Cx 
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This equation still isn't good enough, however. After all, the Cx term overlaps 
with the c x x term in y h . So, you have to multiply by x again to get: 
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x 4 + Bx 3 + Cx 2 

This solution has no terms in common with the homogeneous general solu- 
tion, y h , so you're in business. 

Substituting y p = Ax 4 + Bx 3 + Cx 2 into y " = 9X 2 + 2x - 1 gives you: 

l2Ax 2 + 6Bx+ 2C= 9x 2 + 2x- 1 

Comparing coefficients of like terms gives you: 

124 = 9 
6B = 2 
2C=-1 

which means that: 

A = ¥t 
B = l A 



So the particular solution is: 

v = - x 4 + - x 3 - - x 2 
y p 4 x + 3 x 2 x 



Therefore, the general solution is: 

y=y,+y P =c l x+c 2 +^x 4 +^x 3 -^x 2 

Or, after rearranging to make things look pretty, you get: 
3 , i , i . 

y=y*+y P = +3^ +CiX+c 2 

where you can get c x and c 2 by using the initial conditions. Substituting y(0) 
1 gives: 

y(0) = 1 = c 2 

So c 2 = 1 . Taking the derivative of your general solution gives you: 
y' = 3X 3 + x 2 -x + C\ 
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And substituting the initial condition y'QJ) = 3 gives you: 

3 = Cj 

Here's the general solution with all the numbers filled in: 



y=^x 4 +^x 3 -^x 2 +3x+l 



When is a combination 
of sines and cosines 

Combinations of sines and cosines can be a bit tricky, but with the help of 
the following sections, you can solve equations featuring these combinations 
in a snap. 

Example 7 

Find a particular solution to the following non-homogeneous equation: 
y"-y'-2y= sm2x 

This example looks as though a particular solution may be of the form y p = 
v4sin2x + Bcos2x. There's one way to find out if you're correct; you can substi- 
tute this solution into your equation to get: 

(-6/4 + 25) sin 2x + (-65 - 2/4) cos 2x = sin 2x 

You can now equate the coefficients of sin 2x and cos 2x to get these 
equations: 

-6/4 + 25 = 1 

and 

-65 - 2A = 0 



Multiplying -65 - 2A = 0 by -3 and adding the result to 6^4 + 25 = 1 gives you 
205 = 1. So 5 = Mo. Substituting that number into -65 - 2A = 0 gives you the fol- 
lowing equation: 



^§-24 = 0 
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So A = -Via. Therefore, a particular solution of the original nonhomogeneous 
equation is: 



2Q-sin2x+ 20 



Example 2 

Here's another example using sines and cosines. Try finding a particular solu- 
tion of the following equation: 



y" + I6y = A cos Ax 



Assume that the solution looks like this: 



y p = A cos Ax + B sin Ax 



So far, so good. Now, however, when you plug this solution into the differen- 
tial equation, you get the following result: 

(16A - 16.4) cos Ax + (16B - 165) sin Ax = 4 cos Ax 

Hang on a minute here! The coefficients of cos Ax and sin Ax on the left are 
both zero! So, there are no solutions that are a combination of a sine and a 
cosine that solve the differential equation. You can see why if you take a look 
at the corresponding homogeneous differential equation: 

y" + 16y=0 

The general solution to this homogeneous equation is: 



y = Cj cos Ax + c 2 sin Ax 



This general solution has the same form as your attempted particular solution: 
A cos Ax + B sin Ax. But because that's the homogeneous solution, it isn't going 
to be a particular solution to the nonhomogeneous equation. Instead, you have 
to find another version of y p — one that will result in sin Ax and cos Ax terms 
when differentiated. The simplest form (besides y p = A cos Ax + B sin Ax) that 
can do that is: 



y p = Ax cos Ax + Bx sin Ax 
Give it a try. Here's what y' p looks like: 



y' p =A cos Ax - AAx sin Ax + B sin Ax + ABx cos Ax 
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And y" p looks like this: 
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AA sin Ax - AA sin Ax - l6Ax cos Ax + AB cos Ax + AB cos Ax - \§Bx 



Substituting y" p into the original nonhomogeneous differential equation gives 
you this result: 

-AA sin Ax-AA sin Ax - l6Ax cos Ax + AB cos Ax + AB cos Ax - l6Bx sin Ax + 
l6Ax cos Ax + \6Bx sin Ax = A cos Ax 

Wow! Thankfully, this collapses to: 

-8A sin Ax + 8B cos Ax = A cos Ax 

So, A = 0 and B = 'A, giving you the following particular solution: 



■ sinAx 



And that's that. The general solution to this differential equation is therefore: 
y = c, cos4x + c 2 sin4x + sin4x 



9/ 



When g(x) is a product 
of tu)o different forms 



Here's a neat trick: If your g(pc) term is a product of e' x with sin x and cos x or a 
polynomial, you should attempt a particular solution that's a similar product, 
using coefficients whose values have yet to be determined. 

Ready to see this handy trick at work? Take a look at this differential equation: 

4y" + y= 5e*cos 2x 

Assume that a particular solution is the product of e x and cos 2x and sin 2x: 

y p = ^le^cos 2x + £?e x sin 2x 
Here's the derivative y' p : 

y' p = ^le^cos 2x- 2Ae x sin 2x + Be x sin 2x + 2£e*cos 2x 
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And here's the second derivative y" p : 
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Ae x cos 2x - 2Ae x sin 2x - 2Ae x sin 2x - AAe x cos 2x + Be" sin 2x + 2Be x 
\x + 2Be x cos 2x - 4Be x sin 2x 



or: 



y " p = -3A e" cos 2x - AAe" sin 2x - 3Be* sin 2x + ABe? cos 2x = e x cos 2x (-3A + 
4B) + e*sin2x(-44-35) 

Substituting this into your original differential equation gives you the following: 

4(-3,4e*cos 2x - AAe x sin 2x - 35e*sin 2x + 4Be"cos 2x) + (Ae'cos 2x + Be x 
sin 2x) = Se^cos 2x 

or: 

-lZ4e A cos 2x- \&Ae x sin 2x- 12Be*sin 2x + 16Be x cos 2x + Ae x cos 2x + Be x 
sin 2x = 5e*cos 2x 

Collecting terms gives you this equation: 

(-1L4+ 16£)e*cos 2x + (-16L4 - 115)6" sin 2x = Se'cos 2x 

So, matching the coefficients of cos 2x and sin 2x gives you these equations: 
-1L4+ 16B = 5 

and 

-16,4 -115 = 0 

From this equation, A = -1 IB/ 16, and by substituting it into the previous 
equation you get this: 

-121S + 256B = 80 
So, 1355 = 80, or 5 = %. Figuring out A yields: 

-16A - "Vn = 0 
And A = -"At. Therefore the particular solution, y p , is: 

y p = J ^y L e*cos2x + e*sin2x 
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Breaking Oou/n Equations With the 
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What if g(x) isn't in one of the forms that I discuss in the previous sections? 
What if you can't get the method of undetermined coefficients to work? In 
either case, you can always turn to the variation of parameters method. 

So what's this variation of parameters technique? It's a clever one! Say that 
you have the following differential equation: 

y" + p(x)y' + q(x)y = g(x) 

Now assume that you know the solution to the corresponding homogeneous 
equation: 

y" + p(pc)y' + q(x)y = 0 

The general homogenous solution is: 

y h = Cjy, + c 2 y 2 

Here's the first trick: You now replace the constants Ci and c 2 with functions 
Ui(x) and u 2 (x) to find a particular solution. This is what the equation looks like: 

y p = Ui(x)yi + u 2 (x)y 2 

Then you try to find the functions Ui(x) and u 2 (pc) such that this equation is a 
particular solution of the nonhomogeneous differential equation (not the 
homogeneous differential equation). 

Here's the second trick: Substituting this equation into your original nonho- 
mogeneous equation is going to give you one equation in two unknowns, 

and u 2 (x), as well as their first two derivatives. You need a second con- 
straint on the values of Ui(x) and u 2 (x) as well. And because you're looking 
only for a single particular solution, you can choose that constraint on Ui(x) 
and u 2 (x) to make the math easier. 

In the following sections, I explain the basics of the variation of parameters 
method and take you step by step through some interesting examples. I also 
discuss the relationship of this method to one called the Wronskian (see 
Chapter 5 for details). 
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^You need y ' and y" to substitute into your original nonhomogeneous 
Start withy', the first derivative of y p = Ui(x)y! + u 2 (x)y 2 : 

y' = u'i(X)yi + Ui(pc)y\ + u' 2 (x)y 2 + u 2 (x)y' 2 

Here's where the second trick comes in (the one designed to make the math 
easier). Because you get to choose the second constraint on ^(x) and u 2 (x), 
choose the constraint so that: 

u\(x)yi + u' 2 (x)y 2 = 0 

The second trick makes the math easier because now the first derivative 
becomes: 

y' = Ui(x)y'i + u 2 (x)y' 2 

Quite a bit simpler, right? Now fory": 

y" = u\(x)y\ + Ui(x)y" + u' 2 (x)y' 2 + u 2 (x)y" 2 

Now substitute y, y ', and y" into the nonhomogeneous equation. The resulting 
equation is going to look messy, but don't fret because something good 
happens: 

"lWb'i " + P(x)yi ' + <7(x)yi] + ti 2 (x)[y 2 " + p(x)y 2 ' + q(x)y 2 ] + u' 1 (x)y 1 ' + 

u' 2 (*)y 2 ' = g(x) 

Note that the first two terms are zero (that's the good thing that happens), 
because y x and y 2 are solutions of the homogeneous equation. This means 
that you're left with: 

u' 1 (x)y 1 ' + u' 2 (x)y 2 ' = g(x) 

You now have two equations in u'i(x) and u' 2 (x): 

u\(x)yi(pc) + u' 2 (x)y 2 (x) = 0 
u' 1 (x)y 1 '(x) + u' 2 (x)y 2 '(x) = g(x) 

^.tftBE^ Using these equations, you can solve for u\(x) and u' 2 (x). Then you can inte- 
&/..JL\ g rate them, and you'll have a particular solution to the original nonhomoge- 
neous differential equation, because where yi andy 2 are linearly independent 
solutions of the homogeneous equation: 

y p = Ui(x)yj(x) + u 2 (x)y 2 (x) 
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olidify the basics in your mind, put them to work with the following 
'ial equation: 

y" + 4y = sin 2 2.x: 

The homogenous equation is: 

y"+4y = 0 



The general solution to the homogeneous equation is the following (I'll skip the 
details here; you can find out how to complete this step earlier in this chapter): 

y h = C! cos 2x + c 2 sin 2x 

So: 

y, = cos 2x 

and 

y 2 = sin 2x 

This means that you'll be searching for a particular solution of the following 
form: 

y p = Ui(x") cos 2x + u 2 (x) sin 2x 

where you need to determine u^x) and u 2 (x). The method of variation of 
parameters tells you that: 

u\(x)yi(x) + u' 2 (x)y 2 (x) = 0 
u\(x)yi'(x~) + u' 2 (x)y 2 '(x) = g(x~) 



Substituting in for y t and y 2 gives you these equations: 

u\(x) cos 2x + u' 2 (x) sin 2x = 0 
-2u\(x) sin 2x + 2u' 2 Qc) cos 2x = sin 2 2x 

Solving these equations for u\(x) and u' 2 (x~) gives you: 
U ' i{x) = zs^2x 
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and: 

sin 2 2xcos2x 



You can integrate to find Ui(x) and u 2 (x): 
cos2x cos 3 2x 



and: 

u 2 (x) 



12 



sin 3 2x 
12 



Why aren't you using any constants of integration here? Because you need 
only one particular solution, so you can choose the constants of integration 
to equal zero, which means that the particular solution is (after the algebra 
and trig dust settles): 

/ \ _ cos 2 2x sin 2 2x 

y P ( x >- 6 12 

So, the general solution of your original nonhomogeneous equation is: 

y = yn + y P 

which means it looks like this: 



y = c, cos2x + c 2 sin2x + cos fi 2x + sin 2x1 




Beautiful. 



Appiyinq the method to 
any linear equation 



As you can see from the previous sections, the method of variation of para- 
meters can be useful. It's broader in application than the method of undeter- 
mined coefficients that I discuss earlier in this chapter. Why? The method of 
undetermined coefficients works only for a few forms of g(x). 

^jjjftBEfl On the other hand, you can use the method of variation of parameters for all 
2&f f[\ linear differential equations (linear in y). For second order differential equa- 
tions like the ones in this chapter, you get a system of two equations to solve; 
for a system of three differential equations, you get three equations to solve; 
and so on. The problem comes in the integration of u\(x), u' 2 (x), and so on, 
because the integration may not be possible. 



Chapter 6: Studying Second Order Linear Nonhomogeneous Differential Equations 



DropBoo 



Take a look at an example that brings this issue to light. Here's a whopper of 
a differential equation: 





Why is this equation such a whopper? Well, for starters, it isn't separable 
(see Chapter 3 for an explanation of separable equations). And to top it off, 
you can't use the method of undetermined coefficients. But it's linear, so you 
can use the method of variation of parameters, as you find out in the follow- 
ing sections. 

The general solution of the homogeneous equation 

First, take a look at the homogeneous equation: 

d 2 y 2 dy 2y _ 
dx 2 x dx x 2 

You may notice that this equation looks a little more manageable than the 
original one. After looking at the form of this differential equation and noting 
that each successive term has another power of x in the denominator, you 
would likely decide to try a solution of the form y = x". And by substituting 
into the differential equation, you get: 

n(n-Y)x n - 2 - 2nx"- 2 + 2x"~ 2 = 0 

After dividing by x"~ 2 and doing a little algebra, you get: 



So: 



n -n-2n + 2 = 0 



if - 3n + 2 = 0 



You can solve this with the quadratic equation to get: 
n 2 

So rii = 1 and n 2 = 2, which means that you have two linearly independent 
solutions of the homogeneous differential equation: 

yi=x 

and 

yi = x 2 
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You get the following as the general solution of the homogeneous differential 
equation: 



lX + C 2 X 

The particular and general solutions of the nonhomogeneous equation 

Now you have to find the particular solution, y p , of the original nonhomoge- 
neous differential equation. Why? Because its general solution is the sum of 
the general solution of the homogeneous differential equation and the partic- 
ular solution of the nonhomogeneous differential equation: 



y = yn+y P 

Say you have a linear differential equation of the following form: 

y" + P(x)y' + q(x~)y =g(x) 
In this case, it's a doozy of an equation, and: 

P{x)= x 
<7(x) = p 
g(x) = iln(x) 

Okay, so you can't use the method of undetermined coefficients. Never fear; 
this is where the method of variation of parameters comes in. Accordingly, 
you plan a solution of the following form: 

y p = u x (x)x + u 2 (x)x 2 

The method of variation of parameters gives you: 

"'lOOyiQO + u' 2 (x)y 2 (x) = 0 
u\(x)yi'(x~) + u' 2 (x)y 2 '(x) =g(x) 

So: 

u\(pc)x + u' 2 (x~)x 2 = 0 

and: 

u' ,(x) + u 2 (x) 2x = i ln( x) 
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From: 

")-v + </';,(, v):r = 0 

you get: 

u\(x) = -u' 2 (x)x 
And substituting that into the second equation gives you: 

-u' ,(x) x + u' 2 (x)2x = -^\n(x) 
So with a little combining, you get: 
u' 2 (x) = -^jln(x) 

Substituting that equation into u\(pc)x + u' 2 (x)x 2 = 0 gives you the following: 
u\(x) = -jf ln(x) 

Now you have u\(pc) and u' 2 (pc), and you have to integrate them. (Tip: You can 
find the integrals in most standard calculus books.) Here are the answers (as 
in the previous section, neglecting any constants of integration, because you 
need only one particular solution): 

Ul (x)=-±ln\x) 

and: 

u,(x)= --y ln(x) - i 
Substituting that into the following equation: 

y p = u^xjx + u 2 (x)x 2 
gives you: 

y p = -f\n 2 (x)-x\n(x)-x 
Alright. You're almost there! Because: 



y = yh + y P 
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you know that: 

k^^^ lX + ClX2 ~ Y' n2 (*) -x)n(x)-x 
In fact, you can absorb the final -x term into CpC, giving you the general 
solution: 

y=c l x+ c 2 x 2 - £ ln 2 (x) -x\n(x) 



What a pair! The (/aviation of parameters 
method meets the Wronskian 

As noted in the previous sections, the method of variation of parameters 
allows you to tackle linear differential equations, such as this second order 
differential equation: 

y" + p(x)y' + q(x~)y = g(x~) 

The method of variation of parameters relies on the solution to the homoge- 
neous equation: 

y" + p(pc)y' + q(x)y = 0 

The solution to the homogeneous equation is: 

y h = c^Qc) + c 2 y 2 {x) 

The method of variation of parameters says that you then try to find a partic- 
ular solution of the following form: 

y„ = Ui(x)y!(x) + u 2 (x)y 2 (pc) 

Substituting y p into the differential equation gives you these two equations: 

u\(x)yi'(x~) + u' 2 (x)y 2 \x) = g(x) 

You can formally solve these equations for u\(x) and u' 2 (x) as follows: 
-y 2 (x)g(x) 



u\(x) ■ 



and: 



u' 2 (x) 



y 1 (x)y' 2 (x) -y\(x)y 2 (x) 



y t (x)g(x) 
y l (x)y' 2 (x)-y\(x)y 2 (x) 
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In fact, it turns out that the denominator is the Wronskian (introduced in 
Chapter 5), W, for y lt y 2 , and x, W(y h y 2 )(x): 

Vi(x)y' 2 Qc) - y x '(x)y 2 (x) 



So, you can write the equations for u\(pc) and u' 2 (pc) like this instead: 

-y 2 (x)g(x) 



u\(x) ■ 



and: 



u' 2 (x) 



W(y u y 2 )(x) 
W(y u y 2 )(x) 



Note that dividing by the Wronskian is okay because y t and y 2 are a set of lin- 
early independent solutions, so their Wronskian is nonzero. This means that 
you can solve for Ui(x) (at least theoretically) like this: 



u l {x)=-f 



y 2 (*)g(*) 



■dx+Ci 



W( yi ,y 2 )(x) 
And you can solve for u 2 (x) like this: 

u 2 (x)=f- y > {x)g(x) 



W( yi ,y 2 )(x 



dx+ c, 



Of course, there's no guarantee that you can perform the integrals in these 
equations. But if you can, you can get u^x) and u 2 (x), such that a particular 
solution to the differential equation is: 

y„ = UityyiQc) + i7 2 (x)y 2 (x) 

The general solution is: 

y = c x yi(x) + c 2 y 2 (x) + u^x^iCx) + u 2 (x)y 2 (x) 



Bouncing Around With Springs V Things 

Second order differential equations play a big part in elementary physics. 
They're used in describing the motion of springs and pendulums, electromag- 
netic waves, heat conduction, electric circuits that contain capacitors and 
inductors, and so on. I provide a couple of examples of second order differen- 
tial equations in the following sections. 
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pw you the differential equation describing the motion of a mass on 
f a spring. Say, for example, that you have the situation shown in 
Figure 6-1, where a mass is moving around (without friction) on the end of a 
spring. In the following sections, I show you how to solve this physics prob- 
lem with the help of a nonhomogeneous equation. 




Turning the physics into a differential equation 

The force that the spring in Figure 6-1 exerts on the mass is proportional to 
the amount that the spring is stretched, and the constant of proportionality 
is called the spring constant, k. Thus the force that the spring exerts on the 
mass is: 

F=-ky 

where k is the spring constant (which you have to measure for every spring 
you want to use) and y is the distance away from the equilibrium position 
(where the spring is unstretched). 



The minus sign is included to indicate that the force is a restorative force, 
meaning that it always pulls toward the equilibrium position. So the force is 
always in the opposite of the direction you're pulling. If x, the distance from 
the equilibrium position, is positive, the force exerted by the spring is nega- 
tive, pulling back toward the equilibrium position. 
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The force exerted by the spring is proportional to the length by which you're 
pulling the spring. As you may know from elementary physics, the force on 
is equal to its mass multiplied by its acceleration: 



where m is the object's mass, and a is its acceleration. 

Here's where the differential equation comes in, because acceleration is the 
second order derivative of distance with respect to time (symbolized by f): 

You can write the equation for force like this: 

In keeping with the notation I use throughout this book, I'll write the previous 
equation like this, where the second derivative of distance with respect to 
time is given byy": 



F= my" 




Note that in physics, differentiating by time is often given by putting a dot 
above the variable being differentiated, and differentiating twice with respect 
to time is given by placing two dots above the variable being differentiated, 
like this: e. 



The mass is accelerated by the spring, soF= ma is equal to F= -ky. So you 
have this: 



my" = -ky 



You're back in differential equation territory again, so now you'll take over 
from the physicists. Here's what this equation looks like in a form you're 
more used to: 



my" + ky = 0 



This equation is okay, but it's a homogeneous differential equation. And this 
is, after all, a chapter on nonhomogeneous differential equations. To solve 
this dilemma, you can add a periodic force, acting on the mass, say F 0 cosco 0 f. 
Adding this force makes this a nonhomogeneous differential equation: 



my" + ky = F 0 cos co 0 f 
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You're driving the mass with this new force, F 0 cos co 0 f. This is a periodic force, 
with period (that is, the time it takes to complete a cycle): 



What's going to happen now that the mass is subject to the spring force and 
the new driving force? You can find out by solving my" + ky = F 0 cos co 0 f. 

The general solution to the homogeneous equation 

To solve my" + ky = F 0 cos co 0 f, you need to take a look at the corresponding 
homogeneous equation: 

my" + ky = 0 

Put this equation into standard form, like so: 

/+* = 0 

In other words, the equation looks like this: 

. ky 

y = -w 

Now you need something that changes sign upon being differentiated twice, 
which means that you need to use sines and cosines. So assume that: 

yi = cos cox 

and 

y 2 = sin car 

Plugging yi and y 2 into the y " equation, you get: 



or: 

®=fm 

So the general homogeneous solution is: 



y h = Cj cos cox + c 2 sin cox 
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The particular and general solutions to the nonhomogeneous equation 

Now you have to find a particular solution to the nonhomogeneous equation: 




+ ky = F a cos co 0 f 
which you can write as: 

. ky F 0 

y + ik = -m cosco 0 f 

Using the method of undetermined coefficients that I describe earlier in this 
chapter, you can guess that the particular solution is of the following form: 

y p = A cos co 0 f 

where A is yet to be determined. 

You can dispense with the B sin a> 0 t term because the differential equation 
involves only y " and y, and g(pc) is a cosine. So the B in B sin a> 0 t would have to 
be zero. 

Plugging your attempted solution into the nonhomogeneous equation yields: 

2 h F 

-A CQ„ COSC0 0 f + 7jy^COSC0 0 f = 7^COSCD 0 f 

or, since k/m = co 2 : 

2 F 
-A CQ 0 "COSCQ 0 f + .4 co 2 cosco 0 f= 7^COSC0 0 f 

Dividing by cos co 0 f to simplify gives you: 

2 F 

-A a> 0 +A ® 2 =jf[ 



Or: 

A^o) 2 - co 0 ' 

So: 

F 

A- 



m 



And: 

F„cosco„f 



m(co 2 - co 0 2 ) 
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The general solution to the forced spring differential equation is: 

F 0 cosco 0 f 



! cos cox + c 2 sincox + ■ 



m 



(co 2 -co 0 2 ) 



You can see the graph of a representative solution, with c x = c 2 = 1, co = 1, co 0 = 
and F 0 /m(co 2 - coo 2 ) = 1, in Figure 6-2. 



Figure 6-2: -1 

Graphing 
the math 
behind a 
mass 

without 

friction. 




A mass With dray force 



In this section is another example, but this time you include a drag force on 
the mass. (You don't have to read this example if you don't want to. If you do, 
be forewarned that the algebra gets a little involved.) 



A drag force acting on a mass is referred to as damping. For example, the mass 
may be moving through water or heavy fluid, and the damping force tends to 
slow it down. The damping force is usually proportional to the speed of the 
mass (the faster it goes, the more damping force there is), and the constant of 
proportionality is y, the damping coefficient. So here's what the differential 
equation of motion looks like with damping: 



my" + yy' + ky = 0 
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You now have a term my', the speed of the mass on a spring. So how do you 
solve this one? Well, you can try a solution of the formy = e n (which includes 
cosines if r is complex). Plugging this solution for y into the previ- 
tion gives you: 




mr 2 e" + yre rl + ke r ' = 0 
Canceling out e" gives you this characteristic equation: 

mr 2 + yr + k = 0 
The roots look like this: 

-y± (y 2 - 4m/?)" 2 



r,,r, 



2m 



Look at the case where the discriminant, y - 4mk, is less than zero. In that 
case: 



r,,r 2 



y± ;(4m/?-y 2 
2m 



So substituting r x and r 2 into e rt , the solution can be written as: 

y = e*" 2m (A cos cof + B sin cof) 
where: 

(4km -y 2 ) 



2m 



The solution to the example is an interesting result. It indicates that the 
motion of the mass is sinusoidal (like a sine wave), but it's also multiplied by 
an exponential that decays with time. So in this case, the mass oscillates with 
a diminishing amplitude, tending toward zero motion. The usual way that the 
solution is written is to let A = C cos 5 and B = C sin 5, where 5 is called the 
phase angle. Now you can write the solution this way: 



y=Ce-^ ra cos(cof-5) 



Writing the solution this way gives you the result in an even neater form. As 
you can see, in this case, the solution has a decaying sinusoidal form — the 
cos (cof - 5) is multiplied by e" y " 2m , which goes to zero in time. 

This reaction is just what you'd expect from a damped mass on a spring — it 
would start oscillating, as you'd expect, and then slowly its motion would die 
away. Think of a mass on a spring immersed in oil, for example. 
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You can see a representative graph showing the mass's motion in time in 
Figure 6-3. 



Figure 6-3: 

Graphing 
the math 
behind a 
mass with 
drag force. 





Chapter 7 

Higher Order 
Linear Homogeneous 
Differential Equations 

In This Chapter 

Discovering the notation of higher order differential equations 
Introducing the fundamentals of higher order linear homogeneous equations 
Working with real and distinct roots 
Checking out complex roots 
Dealing with duplicate roots 
••••••••••••••••••••••••••••••••••••••••••••••••a 

Some technicians from the local nuclear power plant storm into your 
richly appointed office and say "We need you to solve a differential equa- 
tion, and quick." 

"Sure," you say "just let me finish lunch." 

"No," they say, "we need the solution now." You notice that they keep looking 
over their shoulders nervously. 

"And if you don't get your solution now?" you ask, annoyed. 
"Boom," they say. 

You put down your sandwich; this might be a rush job after all. "Okay," you 
say with a sigh, "let me see the differential equation." 

They put a piece of paper in front of you, and then you take a look: 

y"'-6y" + lly'- 6y = 0 
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It's a third order differential equation," they say. 

that," you tell them. 
We only know how to solve up to second order," they wail. 



"Many first and second order methods are applicable to higher order differ- 
ential equations," you say, getting out your clipboard. 

"Can you speed things up?" they ask, fidgeting. 

"No problem," you say. "The solution looks like this:" 

y = c x e x + Qe 2 * + 

"Wow," they say. "That was quick work." Then the techs start hurrying out 
the door without paying you so much as a penny. Good thing you love work- 
ing differential equations. 

This chapter introduces higher order (also called nth order) differential equa- 
tions, and by higher order, I mean any order higher than two. With the help of 
this chapter, you can solve higher order differential equations in a snap, even 
if they aren't a matter of life and death! I focus on tips and tricks for solving 
different kinds of higher order linear homogeneous equations (in other 
words, those that equal zero). 



The Write Stuff: The Notation of Higher 
Order Differential Equations 

Before I get into the nitty-gritty of higher order differential equations in the 
following sections, you need a primer on their notation. Why? Well, they're 
slightly different from first and second order equations. For instance, here's 
an example of a higher order differential equation: 

As you can see, this involves the fourth derivative of y with respect to x, so 
it's a fourth order differential equation. If you've read the first few chapters of 
this book, you may expect that you can also write the equation like this: 



y""-y = o 
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Surprise! Instead, this equation is usually written as: 

y-o 




Note the terminology: Instead of writing y"", you write y (4) . Derivatives up 
to third order, y"\ are commonly written using primes, but when it comes to 
fourth order and up, go with the y m notation. After all, what would you 
rather see: 

y (9) -y = 0 

or: 




y 



■y = 0 



In some books, you may see higher order derivatives given with Roman 
numerals, like this: 

y' x -y = 0 



But because Roman numerals are on their way out in common usage today, 
I stick with the y (£ ° version here. 



Introducing the Basics of Higher Order 
Linear Homogeneous Equations 

Are you ready? It's time to dig into higher order linear homogeneous differen- 
tial equations. I start from the beginning in the following sections, with infor- 
mation on their format, solutions, and initial conditions. I also provide some 
handy theorems to help you on your way. 




The format, solutions, and initial 
conditions 

A general higher order linear differential equation looks like this: 

d"y c/" _1 y d"~ 2 y dy 

^+Pi( X )-^+P2(x)-^T+... + P n - 1 (x)- d ^+Pn(x)y = g(x) 
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This differential equation is linear in all derivatives of y with respect to x (it 
involves only terms to the power 1), and it's nonhomogeneous because it 
e function g(pc). 



The homogeneous version of this differential equation looks like this: 

-fi?r + Pi( x )-^r + P^ x )-d^ + --- + P-i(jf)^ + Pn(x) y = 0 
where g(pc) = 0. 



Because homogeneous equations equal zero, working with them is a nice way 
to ease into the world of higher order equations. You take a look at the higher 
order homogeneous differential equation in this chapter, and then you delve 
in to the nonhomogeneous version in Chapter 8. 

Say, for example, that you have some solutions of the homogeneous 
equation — y u y 2 , and so on. If y u y 2 , and so on are all solutions, then a linear 
combination of them is also a solution. For instance: 



y = c x y x + c 2 y 2 + ... c nA y n _! + c„y„ 

In this solution, c stands for various constants. (See the later section "The 
general solution of a higher order linear homogeneous equation" for more 
information.) 

In addition, higher order differential equations can have initial conditions, 
just as first order and second order differential equations can. For a higher 
order differential equation, you can have this many initial conditions: 

X*o) = y 0 , y'Qco) =y' 0 ... jP*(xd = y ln ~ 1} 0 

Solving differential equations of higher order where n = 3 or more is a lot like 
solving differential equations of first or second order, except that you need 
more integrations and have to solve larger systems of simultaneous equa- 
tions to meet the initial conditions. To satisfy all these initial conditions, you 
end up with a series of simultaneous equations, one fory(x 0 ) = y 0 , one for 
y'Qco) = y'o, and so on: 



CiJi + c 2 y 2 + . . . c n _,y nA + c„y„ = y Q 

Ciy'i + c 2 y' 2 + ... c n _!y' n _i + c n y'„ =y' 0 

Ci/'i +c 2 y' 2 + ... c„_iy"„_i + c„y"„ = y" 0 

Ciy i + c 2 y 2 + • ■ • c„_iy „_i + c„y „ - y 0 
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lowing sections, I give you a couple of helpful theorems about higher 
ear homogeneous differential equations. Put them to good use! 



The general solution of a higher order linear homogeneous equation 

You may wonder whether the solution you've found to a homogeneous equa- 
tion, y = c x yi + c 2 y 2 + • ■ ■ c^y^ + c n y„, is a general solution. In other words, you 
want to figure out whether it encompasses every solution of the differential 
equation. And that brings me to a theorem about the general solution of a 
higher order linear homogeneous differential equation. 

If you have n solutions, y lt v 2 , . . . y n , of a general linear homogeneous dif- 
ferential equation of order n: 

d"y , ,d"~'y , ,d- 2 y . ,dy 

then a linear combination of those solutions: 




y = c,yt + c 2 y 2 + ■■■ c n _i.y„_i + c„y„ 

encompasses all solutions if y„ y 2 , . . . y n are linearly independent. 

What does it mean to be linearly independent? 'Well, the functions f u f 2 , f 3 . . . f„ 
are linearly dependent if there exists a set of constants C\, c 2 , c 3 ... c„ (not all of 
which are zero) and an interval / such that: 

dfx +c 2 f 2 + ■■■ tV/n-l + cj n = 0 

for every x in /. The f u f 2 , f 3 . . . f„ are linearly independent if they aren't linearly 
dependent. It's as simple as that. 

If you have n linearly independent solutions for a linear homogeneous differ- 
ential equation of order n, you have a fundamental set of solutions for the dif- 
ferential equation. The general solution to the linear homogeneous differential 
equation is a linear combination of the functions in the fundamental set of 
solutions. 



In other words, it's the same story as I discuss in Chapter 5 for second order 
linear homogeneous differential equations — only here it's generalized for 
higher orders. 
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Solutions as related to the Wronskian 

Yqy can cast the theorem in the previous section in terms of the Wronskian, 
the determinant of this matrix for a higher order differential equa- 
Chapter 5 for full details about the Wronskian): 








y-i 


y 3 


■ y„ 




y\ 


y\ 


y\ 


■ y\ 


' 2 ,---y„) = 


y\ 


y% 


y% 


■ y\ 




y ( "A 


y*~ l \ 


y*-\ ■ 





Here's the theorem from the previous section written in terms of the 
Wronskian: 



If you have n solutions, y u y 2 , • ■ ■ y n , of a general linear homogeneous dif- 
ferential equation of order n: 

^ + Px{x)-£^+p 2 {x)-£^+... + p„.,{x)%+P„(x)y = Q 



dx 



dx 



dx 



and if their Wronskian, W(y u y 2 . . . y^)(x) * 0 in an interval / for at least 
one point x 0 in that interval, then all solutions of the homogeneous equa- 
tion are encompassed by linear combinations of those solutions. 



Tackling Different Types of Higher Order 
Linear Homogeneous Equations 

In the following sections, you can check out several different cases of higher 
order linear homogeneous equations: those with real and distinct roots, real 
and imaginary roots, complex roots, and duplicate roots. 

Real and distinct roots 

The following sections walk you through one third order equation and one 
fourth order equation, both of which have real and distinct roots. 

A third order equation 

Start by taking a look at the third order differential equation you solved at the 
beginning of this chapter: 



y"'-6y"+ lly'-6y = 0 
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Assume these initial conditions: 
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tt) = 9 

20 




y"(0) = 50 

This differential equation has constant coefficients (see Chapter 5 for more 
information), so you can start by assuming a solution of the following form: 

y = e r > 

Plugging this solution into your original equation gives you: 

rV'-6rV'+ llre r '-6e rf =0 
Canceling out the e" yields: 

r 3 -6r 2 + llr-6 = 0 

The latter is the characteristic equation for the original homogeneous equa- 
tion (check out Chapter 5 for more on characteristic equations). How do you 
solve this equation for the roots? 

Here's when you start seeing one of the difficulties of higher order differential 
equations — they're like first and second order differential equations, only 
more so. That is, a second order differential equation gives you a second order 
characteristic equation, which you can solve with the quadratic equation. 
But what if you're faced with a differential equation of order 5? There is no 
"quintic" equation — you're on your own when it comes to finding the roots. 

In the case of the characteristic equation in this example, you can (luckily) 
factor it into this: 

(r-l)(r-2)(r-3) = 0 

So the roots are: 

r,= 1 

r 2 = 2 
r 3 = 3 

The roots are real and distinct, and the linearly independent solutions are: 

y 3 = e 3 * 
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So the general solution to the original homogeneous equation is: 
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Now turn 



,er + c 2 e + c 3 e 



Now turn to the initial conditions. In addition to the form for y, you also need 
y' and y" to meet the initial conditions: 

y' = c x e x + 2c 2 e & + 3c 3 e 3x 

and 

y" = c x e x + Ac 2 e 2x + 9c 3 e 3x 

From the initial conditions, y(0) = 9, y'(0) = 20, and y"(0) = 50, here are your 
three simultaneous equations in c u c 2 , and c 3 : 

y(0) = c 1 + c 2 + c 3 = 9 
y'(0) = c, + 2c 2 + 3c 3 = 20 
y"(0) = c, + 4c 2 + 9c 3 = 50 

^jj\\NG/ Once again, here's another place where you see the difference between first 
^/ an d second order differential equations and those of higher order. With first 

order differential equations that have initial conditions, solving for is trivial. 
With second order differential equations that have initial conditions, you end 
up with a 2 x 2 system of equations — and solving that is easy. However, start- 
ing with third order differential equations that have initial conditions, the nxn 
system of simultaneous equations can be a little more challenging. 

\\V ^ Solving a 3 x 3 system of simultaneous equations for c h c 2 , and c 3 involves 
" some tedious algebra. You can calculate this out if you want to invest the 

time, or you can just use a computer. If you want to solve the system online, 
there are various services to do so. One such Web site is math, cowpi . com/ 
systemsolver, which is a handy tool. You can simply select the type of 
system you're dealing with (such as 3 x 3, 4 x 4, and 5 x 5), plug in the right 
numbers, and voila! You have an answer. 

The solutions of your equations, simply stated, are: 

ci = 2 
c 2 = 3 
c 3 = 4 
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So the solution of the original homogeneous equation with the initial condi- 
tions applied is: 
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Cool. Good work! 
A fourth order equation 

Now you're ready to try a differential equation of fourth order. Take a look at 
this beauty: 

y w + 10/" + 35/ + 50y + 24 = 0 

Yep, that's a whopper. And it has initial conditions, too: 

y(0) = io 

/CO) =-20 

y"(0) = 50 

/"(0) = -146 

The differential equation has constant coefficients, so you can try a solution 
of the following form: 

y = e rx 

Substituting this solution into your original homogeneous equation gives you: 

r 4 e rx + lOrV* + 35rV* + 50re rx + 24e rx = 0 

And dividing by e rx gives you this characteristic equation: 

r 4 + 10r 3 + 35r 2 + 50r+24 = 0 

Okay, now you're in a pickle. What are the roots of this equation? Well, by just 
looking at it, you can figure out that it can be factored this way: 

(r + l)(r + 2)(r + 3)(r+4) = 0 

Just kidding — you can't really tell that just by looking at the equation; I only 
knew because I'm the one who made up the problem. So, if you have a char- 
acteristic equation like this one that's tough to factor, you can turn to online 
equation solvers. One of my favorites is www.hostsrv. com/webmab/appl/ 
MSP/quickmath/02 /pageGenerate?site=guickmath&sl=equations&s2= 
solve&s3=basic (yes, I know — that's a heck of an URL). A quick tip: When 
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you enter variables raised to any power, be sure to add a caret (for instance, 
you enter r 2 as r A 2). After you enter your equation, click the Solve button, 
ur equation is factorable, you'll get the roots. 



The roots of your characteristic equation are: 

r, = -l 

r 2 = -2 

r 4 = -4 

In other words, you have these three linearly independent solutions: 

y = e- x 
y 2 = e- 2 * 
y, = e-** 
y^e 4 * 

So the general solution to the original homogeneous equation is: 

y = c x e~ x + c 2 e _2j; + c^e' 3 " + c^e** 

To meet the initial conditions, you need y', y", and y'"\ 

y' = -c t e* -leg** - - 4^ 
y" = Cl e' x + 4c 2 e 2x + 9c^' 3x + 16c 4 e^ 
y'" = -c x e x - 8c 2 e- 2x - 21 Ci e ix - 64c 4 e~ 4x 

Substituting the initial conditions gives you: 

y(0) = Ci + c 2 + c 3 + c 4 = 10 
y'(0) = -c x - 2c 2 - 3c 3 - 4c 4 = -20 
y"(0) = Q + 4c 2 + 9c 3 + 16c 4 = 50 
y"'(0) = -c, - 8c 2 - 27c 3 - 64c 4 = -146 

Well, this is another fine mess — you have a 4 x 4 system of simultaneous 
equations in c u c 2 , c 3 , and c 4 . You can invest the time to solve it algebraically, 
or you can use a program to solve this system, such as math . cowpi . com/ 
systemsolver (which I mention in the previous section). 
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You can see that: 
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c 3 = 2 
c 4 = 1 

which makes the general solution, including initial conditions, to the original 
homogeneous equation look like this: 

y = 4e x + Ze 7 * + le 3 * + e 4 " 



Real and imaqinaxy roots 

Linear homogeneous equations with constant coefficients often have both 
real and imaginary roots. Check out this equation, for instance: 

y w -y-0 

Here are the initial conditions: 

y(0) = 3 
y'(O) = i 
y"(0) = -i 

/"(0) = -3 

Because this is a linear homogeneous differential equation with constant 
coefficients, you decide to try a solution of the following form: 

y = e r > 

Plugging the solution into the original equation gives you: 
rV'-e r ' = 0 

After canceling out e", you get this equation: 
r 4 - 1 = 0 
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As you may have noticed, this is a more manageable characteristic equation 
than the one in the previous section. You can easily factor this characteristic 
into: 



(f- 1) (r 2 + 1) = 0 

So the roots of this characteristic equation are: 

r, = l 
r 2 = -l 
r 3 = i 
n = -i 

It looks as though you have real and imaginary roots for r 3 and r 4 . You can 
handle complex roots with the following relations: 

and: 

Here, a = 0 for r 3 and r 4 , and you get: 
e ,|3x = cos (3x + i sin (3x 

and: 

e~® x = cos |3x - 1 sin (3x 



So y 3 and y 4 can be expressed as a linear combination of sines and cosines. 
Thus you have these solutions: 

y, = e" 

yi = e x 
y 3 = cos x 
y 4 = sin x 

The general solution to the original homogeneous equation is: 

y = Qe* + c 2 e~* + c 3 cos x + c 4 sin x 
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^What happened to the i multiplying sin fte? As I discuss in Chapter 5, the /' can 
be absorbed into the constants c 3 and c 4 , because /' is, after all, just a constant. 
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v". and v'" 



(have to handle the initial conditions. To do that, you also need y', 
y", and y" 

y' = - c 2 e x - c 3 sin x + c 4 cosx 
y"= c x e x + c 2 e* - c 3 cos x - c 4 sin x 
y'" = Qe* - c 2 e x + c 3 sin x - c 4 cos x 

Substituting the initial conditions into the equation gives you: 

y(0) = c, + c 2 + c 3 = 3 
y'(0) = c, -c 2 + c 4 = 1 
y"(0) = c, + c 2 - c 3 = -1 
y'"(0) = c 1 -c 2 -c 4 = -3 

And there you have it again — a 4 x 4 system of simultaneous equations. 
You can solve this system by doing the algebra, or you can make it easy 
on yourself and check out an online simultaneous equation solver, such as 
math . cowpi . com/systemsolver. Go ahead; I'll wait for you to come up 
with the answers .... 

Ready? So you have: 



c 1 = 0 
c 2 =l 

c 3 = 2 
c 4 = 2 

which means that the general solution with initial conditions is: 

y = e' x + 2 cos x + 2 sin x 

It's lucky that Ci = 0. Why? Otherwise the solution would grow exponentially. 
You can see a graph of the solution in Figure 7-1, where the exponential term 
dies away in time. 
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Figure 7-1: _i 

The solution 
to an 
equation 
with real 

and ~^ 
imaginary 
roots. -4 
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Complex roots 

The previous section handles the case where you have both real and imaginary 
roots. What about the case where you have complex roots? For example, take a 
look at this fine equation: 

+ Ay = 0 

Because this is a fourth order linear homogeneous differential equation with 
constant coefficients, you can try a solution of the following form: 



Plugging the solution into the original equation gives you: 
rV* + 4e rx = 0 

Next, dividing by e™ gives you this characteristic equation: 



r 4 + 4 = 0 
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So now you need the fourth root of -4, which isn't something you're likely to 
find on your calculator. Once again, these equations come to the rescue: 



_ = e^Ccos p* + ; sin fix) 
and: 

e (a-,»x = gcor( cos _ j sin ^ 

You can think of -4 as -4 + Oz, so: 

-4 = 4 cos 7t + 4i sin n = 4e' K 

Note that this relation is determined only up to multiples of 2n, so this is 
actually: 

-4 = 4 cos (7t + 2rac) + 4/ sin (n + 2rm) = 4e K "* 2nn) 
where n is an integer. 

You can therefore find the fourth root of -4 this way: 

(-4) 1/4 = 4 1/4 e'W 4 *" 1 ' 2 ' 

Expanding the exponent gives you: 

(_4)V4 = 41/4 ^ cos + njc/2 ) + j sin (n/4 + /jtc/2)) 

And using different values of n gives you the fourth roots of -4: 

r x = 1 + /' 
r 2 = -1 + 
r 3 = -1 - 
U = 1 - ' 

Great! You've made progress. Now you know that the fundamental set of solu- 
tions is e (1 + ,> , e H + 0 *, e H ~°*, and e°"°*. By using these equations: 

e Cct *®* = e^Ccos + / sin p\xr) 

and 

gee-/©* = e «( cos p x _ / sin p x ) 
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the fundamental set of solutions can be given this way in the general solution: 

ie* cos x + c 2 e x sin x + c 3 e~* cos x + c 4 e~ x sin x 
And that's the general solution of your original homogeneous equation. Cool. 



Duplicate roots 




Duplicate roots are just what they sound like: one or more roots that are 
repeated as you figure out the general solution of a homogeneous equation. 
I describe several types of duplicate roots in the following sections. 

A fourth order equation With identical real roots 

Take a look at this differential equation, which is a fourth order homogeneous 
differential equation with constant coefficients: 

y w + Ay'" + 6y" + Ay' + y = 0 

You can try a solution of the following form: 

y = e' x 

Plugging the solution into the original homogeneous equation gives you this 
characteristic equation: 

r 4 + Ar 3 + 6r 2 + Ar + 1 = 0 

Holy mackerel, you might think. What are the roots of that thing? You can 
factor this equation using an online equation factoring program, such as 

hostsrv . com/webmab/appl /MSP/quickmath/ 02 /pageGenerate? 
site=quickmath&sl=equations&s2=solve&s3=basic. 

If you're determined to rely on your own brain to factor such an equation, 
here's a trick that sometimes helps: Convert the equation from base r to base 
10. That is, r 2 + 2r + 1 becomes 100 + 20+ 1 = 121, which can be easily factored 
into 11 x 11. Converting 11 from base 10 back to base rgives you (r+ 1) (r+ 1), 
so the roots are -1 and -1. You can use this quick trick to astound your friends. 

No matter which method you use, you'll sooner or later figure out that you 
can factor r 4 + Ar 3 + 6r 2 + Ar + 1 = 0 this way: 



(r + 1) (r + 1) (r + 1) (r + 1) 
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So the roots of the characteristic equation are -1,-1,-1,-1 — all repeated 
real roots. Does that mean the solutions are: 
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yi = e 
y* = e x 

Hardly. You need linearly independent solutions to get a fundamental set of 
solutions from which to build your general solutions. And because these are 
all e~ x , they're obviously not linearly independent. (I talk about linear inde- 
pendence in more detail in the earlier section "The general solution of a 
higher order linear homogeneous equation.") 

What can you do here? Well, clearly you can't have this as the general solution: 

y = C\e x + c 2 e~ x +c^e~ x +c 4 e~ x 
Why? Because that's really equivalent to: 

y = ce* 
where c - c x + c 2 +c 3 + c 4 



So what can you do? Easy: You add powers of x until you have as many linearly 
independent solutions as you need. You can convert y = c x e x + c 2 e~ x + c 3 e~* + c 4 e' x 
into a true general solution by introducing factors of x, x 2 , and x 3 like this: 

y = C\e x + c 2 xe~ x +c 3 x 2 e' x +c 4 x 3 e' x 
A fifth order equation With identical real roots 

Take a look at this whopper, which is a fifth order homogeneous differential 
equation: 

y ©_/«_ 2 /" + 2/' + /-y = 0 

Because it's homogeneous and has constant coefficients, you can try a solu- 
tion in the form y = e rx , giving you: 



re -re 



■ 2rV x + 2r 2 e rx + re" 



After dividing by e rx , you get this equation: 
r 5 -r 4 -2r 3 + 2r 2 + r-l=0 
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Your response may sound something like this: "I'm supposed to factor that? 
Are you crazy?" Never fear; you can turn for help to an online equation 

ch as hostsrv.com/webmab/appl/MSP/quickmath/02/ 
rate?site=quickmath&sl=equations&s2=solve&s3=basic. 



The roots are -1, -1, 1,1,1, so r 5 - r 4 - 2r 3 + 2r 2 + r- 1 = 0 can be factored 
into this: 

(r- 1) (r- 1) (r- 1) (r + 1) (r + 1) = 0 



or: 



(r-l) 3 (r + 1) 2 = 0 



2r 3 



As you can see, this equation looks a lot more manageable than r - 
2r 2 + r - 1 = 0. Because -1 is a root of the characteristic equation, this is a 
solution: 

yi = e x 

In fact, -1 is a double root, which also makes this a solution: 

y 2 = xe x 

Because you can also have 1 as a root, you have this solution: 

Yi = e x 

Finally, you may also notice that 1 is a triple root, so in that case you also have: 

y 4 = xe x 

and 

y 5 = x V 



So the general solution to the original homogeneous equation is: 

y = Cie~* + c 2 xe~" + c?,e x + c 4 xe < + c 5 x 2 e* 

Notice that once again, the general solution is a linear combination of n lin- 
early independent solutions, where n is the order of the differential equation. 
And note that also, you multiply solutions by x, x 2 , and so on depending on 
their multiplicity as roots of the characteristic equation. Here, one root had 
multiplicity 2 and the other multiplicity 3. 
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Identical imaginary roots 

Arf you curious about the case where the roots of a characteristic equation 
cate and imaginary? For example, take a look at this differential 
qUa^iW with constant coefficients: 

/ 4J + 8y" + 16y = 0 

You can try a solution of the following form: 

y = e' x 



Substituting this solution into your original homogeneous equation gives you: 

rV r + 8rV*+16e'* = 0 
So your characteristic equation is: 

r 4 + 8r 2 + 16 = 0 
You can factor this into: 

(r 2 + 4) (r 2 + 4) = 0 

So the roots are 2i, 2i, -2i, and -2i. As you can see, you have duplicate imagi- 
nary roots here. 

You can use these equations as I described earlier in this chapter: 



a (a + if,)x _ ax 



and: 



e^cos (3x + /' sin (3x) 



g<s»-«» = e «(cospr-islnp*) 



Here are the first two solutions, y x and y-,\ 
y x = cos 2x 

and 

y 2 = sin 2x 
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What about y 3 and y 4 ? You can use the same technique as in the previous sec- 
tio_n: Multiply by progressively higher powers of x until you get all the linearly 
;lent solutions you need. In this case, all you need is one power of x 



aJap«"*len 
g\^>u: 



y 3 = x cos 2x 

and 

y 4 = x sin 2x 

So the general solution to the homogeneous equation is: 

y = Cj cos 2x + c 2 sin 2x + opc cos 2x + c 4 x sin 2x 

Identical complex roots 

Here's another example; it's a fourth order equation with constant coefficients: 

y» _ Sy'" + 32y"- 64y' + 64y = 0 

This equation is no problem. You just assume a solution of the form y = e rAr 
and plug it into the original equation to get: 

r 4 e rx - 8rV* + 32r 2 e rx - 64re rx + 64e rx = 0 
So your characteristic equation is: 

r 4 - 8r 3 + 32r 2 - 64r + 64 = 0 

Solving this characteristic equation gives you these roots: 

T\ = 2 + 2i 
r> = 2 + 2i 
r 3 = 2 - 2/ 
r 4 = 2 - 2/ 

So 2 + 2i is a root of multiplicity 2, and so is 2 - 2i. That leads to the following 
general solution: 



y = & 1 e C2+20 * + & 2 *e (2+20jr + & 3 e l 



(2-2i> 



(2-2i> 
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where b u b 2 , b 3 , and b A are constants. You can rewrite this equation as the 
following: 



(V + b 2 xe l,x ) + e\b 3 e- M + b^e l,x ) 
or: 

y = e 2 \b x e 2ui + ft 3 e" 2ul ) + e 2x x(b 2 e hx + £> 4 e~ 2u< ) 
Once again, you can turn to these relations: 
e ,f,x = cos fix + i sin (3x 

and: 

e ~ ,f,x = cos (3x - sin (3x 

Using these equations gives you: 

y = e^Q/iicos 2x + sin 2x) + b 3 (cos 2x - i sin 2xj) + e^xQb^cos 2x + i sin 2x) + 
6 4 (cos 2x - i sin 2x)) 

Combining terms and consolidating constants gives you this form for the 
general solution: 

y = e^ifi cos 2x + c 2 sin 2x) + e 2x x(c 3 cos 2x + c 4 sin 2x) 

And there you go, that's the general solution where the characteristic equa- 
tion has the roots 2 + 2i, 2 + 2i, 2 - 2i, and 2 - 2i. 
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Chapter 8 

DropBool lfkinfl OnHigher Order 

Linear Nonhomogeneous 
Differential Equations 

In This Chapter 

Breaking down higher order equations with the method of undetermined coefficients 
Using the variation of parameters to solve higher order equations 



The door to your office opens. A group of rocket scientists enters, looking 
embarrassed. "We need you to solve a differential equation," they say. 

"I thought you were math specialists," you retort. 

"We thought so too. But this one has us stumped. It specifies the shape of the 
rocket. Without it, we can't take off." They slide a sheet of paper onto your 
desk. "Nobody has to know that we came to you for help, right?" They look 
over their shoulders nervously. 

"Right," you say, taking a look at the sheet of paper, on which you see this 
differential equation: 

y"' + 6y" + lly' + 6>' = 336e 5jc 

The equation has the following initial conditions: 

y(0) = 9 
y'(0) = -7 

y"(0) = 47 
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"It's a nonhomogeneous third order differential equation," the rocket scien- 
tists say. "You're stumped, right? We knew it!" 



st!" you say "The solution is:" 

y = 5e- x + 2e- 2x + e' 3x + e Sx 

The rocket scientists are stunned. "How did you do that?" they ask. 

"Easy," you say. "1 read Chapter 8 of Differential Equations For Dummies. I 
highly recommend it. Here's my bill for solving your equation." 

The rocket scientists take the bill, and, reading it, raise their eyebrows. 
"That's astronomical," they say. 

"Well, you are rocket scientists, aren't you?" you ask. 

This chapter shows you how to handle nonhomogeneous linear differential 
equations of order n, where n = 3, 4, 5, and so on. They look like this: 

^+P,{x)-^+pAx)-^r + ..-+P„. 1 {x)-^ ( +P„{x)y = g{x) 

In a higher order (or nth order) linear nonhomogeneous equation, the p vari- 
ables are various functions. And in this case, unlike in Chapter 7, where I dis- 
cuss higher order homogeneous equations, g(x) *s 0. When you're done with 
this chapter, you'll be able to handle nonhomogeneous equations with ease. 



Mastering the Method of Undetermined 
Coefficients for Higher Order Equations 

I first discussed the method of undetermined coefficients in Chapter 6 for 
second order differential equations like this one: 

y" + P(x)y' + q(x)y = g(x) 



In this chapter, however, I generalize that method to help you get a handle on 
differential equations of arbitrarily high order, not just two. 
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^tABEfl The method of undetermined coefficients is all about finding a particular solu- 
tion to a nonhomogeneous equation, y p . This method says that when you find 
BHLr\ <Ja»di4ate solution, y p , and plug it into the left-hand side of the equation, you 

IHPLy ^jfVl^'th g(x). Because g(x) is only a function of x, it's often possible to 

guess the form of y p (x), up to arbitrary coefficients, and then solve for those 
coefficients by plugging y p (x) into the differential equation. 




The form of g(x) can often tell you what a particular solution looks like Q'ust 
as it can when you're dealing with second order equations). In particular, if 
g(x) is in the form of: 



e rx , try a particular solution of the form Ae rx , where A is a constant. 
Because derivatives of e rx reproduce e rx , you have a good chance of find- 
ing a particular solution this way. 

V A polynomial of order n, try a polynomial of order n. 

A combination of sines and cosines, sinax + cos|3x, try a combinations 
of sines and cosines with undetermined coefficients, ^isinax + Bcos|3x. 
Then you can plug into the differential equation and solve for A and B. 




I explain these different forms in the following sections, but before I get to 
them, here's a summary of the method of undetermined coefficients for a 
higher order differential equation: 



1. Find the general solution, y h = c,y, + c 2 y 2 + . . . + c„y„ of the associated 
homogeneous differential equation. 

2. If g(x) is of the form e rx , a polynomial, a combination of sines and 
cosines, or a product of any of these, assume that the particular solu- 
tion is of the same form, using coefficients whose values have yet to 
be determined. 

3. If gr(jr) is the sum of terms, giOt), g3(?c), and so on (as they are in a 
polynomial), break the problem into various subproblems like this: 
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The particular solution of the nonhomogeneous equation is the sum of 
the solutions of those subproblems. 
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4. Substitute y p into the differential equation, and solve for the undeter- 
mined coefficients. 



pBoote, 



the general solution of the nonhomogeneous differential equa- 
, which is the sum of y h and y p : 



y = y h +y P 

6. Use the initial conditions to solve for c lf c 2 . . . c„. 



When is in the form e™ 

Take a look at the nonhomogeneous differential equation you solve so bril- 
liantly for the rocket scientists at the beginning of this chapter: 

y"' + 6y" + lly' + 6y = 336e 5 * 

Here are the equation's initial conditions: 

y(0) = 9 
y'(0) = -7 
y"(0) = 47 




As with second order differential equations, the general solution to this non- 
homgeneous differential equation is the sum of the solution to the corre- 
sponding homogeneous differential equation, in which g(x) equals 0: 



y"'+6y"+ lly' + 6y=0 

and a particular solution to the full nonhomogeneous differential equation. In 
other words: 

y = yh+y P 

where y h is the general solution to the homogeneous differential equation, 
and y p is a particular solution to the nonhomogeneous differential equation. 

The general solution to the homogeneous equation 

The first order of business is to solve the homogeneous differential equation 
y'" + 6y" + lly' + 6y = 0. This is a third order linear homogeneous differential 
equation with constant coefficients (like in Chapter 7), so you decide to try a 
solution of the following form: 
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And divic 



Plugging this solution into the homogeneous equation gives you: 
+ 6r 2 e™ + llre rA; +6e rjc = 0 





And dividing by e rx (to make things a bit simpler) gives you the following 
characteristic equation (see Chapter 5 for more about this type of equation): 

r 3 + 6r 2 + llr+6 = 0 

If you're feeling extra sharp today and can do the algebra yourself, or if you 
have an online equation solver at your beck and call like the one at www . 

hostsrv. com/webmab/appl/MSP/quickmath/02 /pageGenerate?site= 
guickmath&sl=equations&s2=solve&s3=basic, you can see that the roots 
of this equation are: 

r,=-l 
r 2 = -2 
r 3 = -3 

You can factor r 3 + 6r 2 + 1 lr + 6 = 0 this way: 

(r+ l)(r+2)(r+3) = 0 

So the general solution to the homogeneous differential equation y'" + 6y" + 
lly' + 6y = 0 is: 

y h = c x e x + c 2 e 2x + c^f 3 * 

The particular solution to the nonhomogeneous equation 

After you find the general solution to the homogeneous equation, you have to 
find a particular solution, y p , to the nonhomogeneous equation. In this case, 
g(x) has the following form: 

g(x) = 336e 5 * 

The method of undetermined coefficients says that you should try to match 
the form of g(x) so that differentiating y p gives you the same form, up to the 
value of multiplicative constants. Because differentiating simple exponents 
gives you the same exponent back with possibly a different coefficient, the 
method of undetermined coefficients says that in this case you should tryy p 
of this form: 

y p =Ae 5x 
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or: 



Substituting this solution into the equation gives you: 
e 5x + l50Ae 5x + 55Ae 5x + 6Ae 5x = 336e 5 * 



or: 

USA + 150V4 + 55A + &4 = 336 
Do the math and you get: 
336,4 = 336 

So: 

A= 1 

which means that the particular solution, y p , of the nonhomogeneous equa- 
tion is given by this: 



And because: 

y = yn + y P 

the general solution to the nonhomogeneous equation is: 

y = c x e' x + c 2 e' 2x + c 3 e~ 3x + e 5x 

Applying initial conditions 

To handle the initial conditions of the original nonhomogeneous equation, 
you need to find y, y' and y": 

y = c x e* + c 2 e~ 2x + c 3 e' 3x + e 5x 
y' = -c x e x - 2c 2 e- 2x - 3c 3 e^ + 5e 5x 
y" = c x e* + 4c 2 e~ 2jc + 9c 3 e~ 3x + 25e 5x 

Plugging in x = 0 gives you the following: 

y(0) = d + c 2 + c 3 + 1 = 9 
y'(0) = -Ci - 2c 2 - 3c 3 + 5 = -7 
y"(0) = ci + 4c 2 + 9c 3 + 25 = 47 
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Time to do a little simplifying: 
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|) = c x + c 2 + c 3 = 8 
-Ci - 2c 2 - 3c 3 = -12 
/'(D) = c, + 4c 2 + 9c 3 = 22 




This is a 3 x 3 system of simultaneous equations. You can work it out step 
by step, or you can use a handy equation system solver like the one at 
math . cowpi . com/systemsolver. Either way you work it, you find that c u 
c 2 , and c 3 are: 

Ci = 5 
c 2 = 2 
c 3 =l 

So the general solution to your original nonhomogeneous equation with the 
given initial conditions is: 

y = 5e' x + 2e" 2 * + e ix + e 5x 

Just as you told the rocket scientists at the beginning of the chapter. Nice work! 



When is a polynomial of order n 

Take a look at this differential equation stumper that I put together for you: 

y"'-y' = x + 60e~ 4x + 9 sin x 

It's the triple play: A third degree differential equation that's equal to a poly- 
nomial, an exponential, and a trig function — all at the same time. Seriously, 
though, solving this equation isn't as difficult as you may think; just check 
out the following sections. 

The general solution to the homogeneous equation 

Start by looking for the general solution to the corresponding homogeneous 
differential equation: 

y"'-y' = o 

This equation looks like a linear homogeneous differential equation with con- 
stant coefficients, so you can plug in the handy y = e rx : 

rV*-re r *=0 
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So the characteristic equation, after dropping e", is: 
0 

One root is clearly r = 0, and dividing by r gives you: 
1=0 




The roots of this equation are 1 and -1, and so the solution to the homoge- 
neous differential equation is: 

y h = c 1 + c 2 e* - c 3 e' x 

The particular solution to the nonhomoqeneous equation 

Okay so far so good. But now you have to find a particular solution, y p . In this 

case, g(x) is: 

g(x) = x + GOe -4 * + 9 sin x 

Clearly, you have a polynomial on your hands. What to do? The way to 
handle this situation is to break g(x~) into three parts: 

giQO = x 
g 2 (x) - Sue" 4 * 
g 3 (X) = 9 sin x 

Now you have three differential equations to solve: 



y'" 


-y' 


= X 


y'" 


-y' 




y'" 


-y' 


= sin x 



And the corresponding particular solutions arey pl , y p2 , andy p3 , respectively, 
which means that the general solution of the nonhomogeneous equation is: 

y = y h + y P i + y p2 + y p3 

Alright, start by looking for y pU with gi(x) = x. To do so you have to solve 
y"'-y' = x. 
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Because gi(x) = x here, you may think of using y pl = Ax, but unfortunately, x is 
already a solution of the homogeneous differential equation. So y pX = Ax is 
ad, you can try: 

y P i = Ax 1 

Plugging that solution into y"'-y' =x gives you: 
-2Ax = x 

So: 

A = -y 2 

And therefore: 

y pl = Ax 2 =^f- 

Okay, now fory p2 , which is the solution toy'" -y' = We 4 *. Because g,(x) = e 4 * 
here, you can try a solution of the following form: 

y P 2 = Ae 4x 

Plugging y p2 into y"'-y' = 60e"^ gives you: 
_644e^ + 44^ = 60e 

or: 

-6QAe^ = 60e^ 

So: 

A = -l 

and 

-4x 

y P 2 = -e 

Great! You're making progress. The last thing you have to do is find y p3 , the 
third particular solution. That means solving y"'-y' = sinx, for which you 
may be tempted to try a solution like this: 



oks 



y p3 = Acos x + Bsin x 



Part II: Surveying Second and Higher Order Differential Equations 




However, take a look at the equation you're trying to solve here: 

oks 

The first and third derivatives of Acos x yield terms in sin x, which is what 
you're looking for here, but the first and third derivatives of Bsin x yield 
terms in cos x, which means that B = 0. So try a solution like y p3 = ^4cos x. 
Plugging y p3 into y "' - y ' = sin x gives you: 



Asin x + Asm x = sin x 
After dropping sin x you get: 
A + A= 1 

So: 

A = l A 

which makes y p3 equal to: 
_ cosx 

y p3 2 

You now have all the particular solutions to the nonhomogeneous equation 
(and the general solution to the homogeneous equation from the previous 
section), so you can finally put everything together! Because: 

y = y h + y P i + y p2 + y p3 

you get: 

y = c, + c 2 e x - c 3 e" - ^ - e" 4 * + ^°|^ 



When is a combination 
of sines and cosines 

Here's another higher order problem to work through; this time, the solution 
is a combination of sines and cosines, and the problem is of the fourth order: 

+ 2y " + y = 8 sin x - 1 6 cos x 

Easy, right? All you have to do is find the general solution to the homoge- 
neous equation, followed by the particular and general solutions to the non- 
homogeneous equations. Read on for details. 
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The general solution to the homogeneous equation 

homogeneous differential equation, in which g(x) equals 0, is: 



2y" + y=0 




This is a linear homogeneous differential equation with constant coefficients. 
This means you can try a solution of the form y = e rx . Plugging this solution 
into the homogeneous equation gives you: 

rV* + 2rV* + e rx = 0 
Or, for simplicity's sake: 

r 4 + 2r 2 + 1 = 0 
You can factor this into: 

(r 2 + 1) (r 2 + 1) = 0 

So the roots of the characteristic equation are i, i, -i, and -i. Two solutions to 
the homogeneous differential equation are: 



y, = e" 

and 



y 2 = e 

And because i and -;' are repeated roots, you also have: 

y 3 = x e' x 

and 

y 4 = x e ix 

So: 

y h = b x e lx + b 2 e' x + b 3 x e' x + fe 4 x e' x 
where bi - b 4 are constants. And because: 
e ,f,x = cos (3x + i sin (3x 

and: 

e"** = cos (3x - ;' sin (3x 
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you can express the general solution to the homogeneous equation as: 
Ci cos x + c 2 sin x + c 3 x cos x + c 4 x sin x 

The particular solution to the nonhomogeneous equation 

Now it's time to find a particular solution, y p , of your original nonhomogeneous 
equation. In this case, 

g(x) = 8 sin x - 16 cos x 

You might consider trying a particular solution of the following form: 

y p = A sin x + B cos x 

^jjABE^ But that particular solution isn't linearly independent from y h , which has sin x 
and cos x terms in it. (Linear independence is important to find a complete 
set of solutions; see Chapter 5 for more information.) So you might consider 
a solution of the form y p = Ax sin x + B x cos x. But once again, this solution 
isn't linearly independent with respect to y h , which has terms in x sin x + x 
cos x already. So you're left with the following for y p : 

y p =Ax 2 sin x + Bx 2 cos x 

Substituting this solution into your nonhomogeneous equation, and collect- 
ing terms gives you: 

-8^4 sin x- 8 B cos x = 8 sin x- 16 cos x 

So, comparing terms, you can see that: 

A = -l 

and: 

B = 2 

Now you know that the particular solution is: 

y p = -x 2 sin x + 2x 2 cos x 
The general solution to the nonhomogeneous equation is: 

y=c x cos x + c 2 sin x + c 3 x cos x + c 4 x sin x-x 2 sin x + 2 x 2 cos x 
Wow, a pretty lengthy solution. Impressive! 
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Jg^^j^^andy trick for finding particular 



ilutions in sine and cosine form 



The method of undetermined coefficients (which 
is discussed earlier in this chapter) is based on 
the fact that when <7<x) is of a certain form, you 
can often guess the form of the particular solu- 
tion up to arbitrary coefficients. In fact, you can 
play a neat trick this way. If, for example, you 
have a sixth order homogeneous differential 
equation (yowza!) and know that xV sin xis a 
solution, can you determine the other solutions? 
That is, given that: 



sin x 



can you find y 2 - y e so that all solutions are lin- 
early independent? The short answer is this: 
Yes, you can. Because x 2 e"sin xis a solution, 
so are these two: 

y 2 = e"sin x 

y 3 = x e~*sin x 



Also, because x 2 e"sin xis a solution, so isx 2 e~ x 
cosx, because complex roots of the character- 
istic equation come in conjugate pairs. This 
means that you can find the other three solu- 
tions: 

y< l = e"cosx 

y 5 = xe"*cos x 

y B = x 2 e"cos x 

So the general solution to the homogeneous dif- 
ferential equation that has x 2 e"sin x as a solu- 
tion is: 

y=x 2 e"sm x+ e"s\n x+xe""sin x+ e"'cos 
x+ xe~ x cos x+ x 2 e"cos x 

And you can determine all that starting with just 
one solution, = x 2 e"sin x. 



Soitfinq Higher Order Equations vOith 
Variation of Parameters 

The method of undetermined coefficients, which I discuss earlier in this 
chapter, is good only for certain forms of g(x). For more general differential 
equations of a higher order, you can try the method of variation of parameters. 
This method was first introduced in Chapter 6 for differential equations of 
the second order, but here I generalize it for equations of order n. 




The basics of the method 

To get a good grasp on this method, imagine that you have this general linear 
nonhomonegeous differential equation of order n: 

d "y , ^"-'y . ,d n -'y . .dy . . , . 

^+P,{x)-^+p 2 {x)-^ T + ...+p,,. l {x)-^ c +p„{x)y = g{x) 
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The corresponding homogeneous differential equation is: 
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dly , ,d"- l y , ,d"~ 2 y 



dv 

■ +p„. 1 (x)-^+p n (x)y=0 



If the general solution to the homogeneous differential equation is: 

y h = Ciji + c 2 y 2 + c 3 y 3 + ■ ■ ■ + c n y n 

then the variation of parameters says to look for a particular solution of the 
following form: 

y p = Ui(x)y } + u 2 (x)y 2 + u 3 (x)y 3 + . . . + u„(x)y„ 

where Ui(x), u 2 (x), and so on are functions. 

The method of variation of parameters for differential equations of order n 
says that to find y p , you can solve this system of simultaneous equations for 
u'i(x), u' 2 (x), and so on like this: 

u\yi + u' 2 y 2 + . . . u' n y n = 0 
u\y\ + u' 2 y' 2 + . . . u'„y' n = 0 



u 1/ i + u 2 y 2 + • • • « n y n 



u\y c "- l \ + u' 2 /"- l \ 



u„y 



0 

g(x) 



Then you integrate u\(pc), u' 2 (x), and so on to find Ui(x) and u 2 (pc), which in 
turn gives you y p . 



Working through an example 

Here's an example that can help you get your feet wet with the method of vari- 
ation of parameters. Try solving this differential equation using the method: 

y (4) = 6x 

To do so, you first need the solution to the homogeneous differential equation: 

y (4) = o 

You can solve this equation by integration to get: 

* = 1 

y 2 =x 
y-i=x 2 

y 4 = x 3 
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The homogeneous equation's general solution is: 
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Ci + c 2 x + c 3 x 2 + C4X 3 




Now you insert Ui(x), u 2 (pc), and so on for the constants to find the particular 
solution of the nonhomogeneous solution: 

y p = «i(x) + u 2 (x)x + « 3 (x)x 2 + « 4 (x)x 3 

Here's where the method of variation of parameters kicks in, giving you these 
simultaneous equations in u\(x), u' 2 (x~), «' 3 (x), and u\(x) by integration: 

u\ + u' 2 x + u' 3 x 2 + u' 4 x 3 = 0 
u' 2 + u' 3 2x + u' 4 3x 2 = 0 
u ' 3 2 + u 'fix = 0 
u'fi = 6x 

True, this is a set of four simultaneous equations in four unknowns, but it 
isn't so difficult to solve. Why? Because the equations get progressively sim- 
pler. Starting at the bottom, for example, you can see that after you cancel 
the 6 on each side, you get this: 

u\(x) = X 

You can then substitute that result into the previous equation: 

u ' 3 2 + u 'fix = 0 
to get: 

u\2 + 6x 2 = 0 

So: 

u' 3 (x) = -3x 2 

You can find the others the same way. Here are u'i(x), u' 2 (x), u' 3 (x), and u' 4 (x): 

u\ = -x 4 
u' 2 = 3x 3 
u 3 = -3x 2 
u\ = x 
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Integrating these gives you: 
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u 3 = -x 3 



Because: 

y p = Ui(x)y, + u 2 (x)y 2 + u 3 (pc)y 3 + . . . + u n (x)y n 
the particular solution, y p , equals: 

y " 5 4 * 2 
Or, to even out the denominators: 

_ -4x 5 15x 5 20x 5 10x 5 

y " 20 20 20 20 

So: 

„ _ -4x 5 , 15x 5 20x 5 , 10x 5 

y " 20 20 20 20 

which gives you the long-awaited result: 
y " 20 

Now you know that the general solution of the nonhomogeneous equation is: 

y„=c 1 +c 2 x + c 3 x 2 +c 4 x 3 + |q 

And there you have it — you arrived at the general solution using the method 
of variation of parameters. (Note: You can get the same result by simply inte- 
grating the differential equation four times.) 
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In this part . . . 

■ his part is where I help you pull out the power tools. 

w Here, you use series solutions, Laplace transforms, 
and systems of differential equations. In addition, you 
figure out how to use numerical methods to solve differen- 
tial equations — this is the last-chance method, but it 
rarely fails. 













Chapter 9 

Serious with Power 
Series and Ordinary Points 
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In This Chapter 

Checking out the basics of power series 
Trying the ratio test 
Shifting the index value of a series 
Surveying the Taylor Series 

Putting your knowledge to use by solving second order equations 



■ n Parts I and II of this book, I describe a variety of useful methods for solv- 
«C ing first order, second order, and higher order differential equations. But 
sometimes, those methods, as cool as they are, just won't work. You have to 
solve some differential equations (such as those involving what differential 
equations experts call ordinary points) with a power series — that is, a sum- 
mation of an infinite number of terms. I know this work sounds intimidating, 
but believe it or not, it's sometimes the easiest way to go. I show you what 
you need to know in this chapter. 



Perusing the Basics of Porter Series 

Power series are (often infinite) sums of terms. Here's an example of a 
common power series: 



y=T l a n x" 

n = 0 
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In this series, a n and x" are constants. The infinity sign on top of the sigma 
indicates that n goes from 0 to infinity, and the sigma is the notation for a 
i. This series is shorthand for the following infinite expansion, 
coefficients (a 0 , a h a 2 , and so on) are constants: 

y = a 0 + QpC + + + . . . 




The trouble with an infinite expansion, of course, is that it might diverge. That 
is, it might become infinite as you add more and more terms. Power series 
that become infinite aren't of much help to anyone, so in this chapter, you 
work only with series that stay finite — those that converge to a particular 



value. A power series is said to converge for a particular x if this limit is finite: 

m 

lim 2a„x" 

If this limit is infinite, the series doesn't converge. In fact, your series might 
also converge absolutely. A series is said to converge absolutely if the summa- 
tion of the absolute values of its terms converges (note the use of absolute 
value notation): 

n = 0 ■ 

If a series converges absolutely, it also converges (of course). 

betermininq Whether a Porter Series 
Converges With the Ratio Test 

So how do you know whether a series converges? That's an easy question: 
You use the ratio test. I discuss the basics of this test and provide a few 
numerical examples in the following sections. 



The fundamentals of the rath test 




The ratio test compares successive terms of a series to see whether the series 
will converge. If the ratio of the (n + l)th term to the nth term is less than 1 for 
a fixed value of x, the series is said to converge for that x. The series diverges 
if the ratio is greater than 1. For example, suppose you had this series: 



y=T,a n (x-x 0 )" 

n = 0 
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The ratio of the (n + l)th term to the nth term is: 

, 71 + 1 

X X n I 



To find out whether the series converges or diverges, take a look at the limit 
of the ratio: 



I i \ n+1 \ 
a ni , x-x„ 



lim 



\a„{x-x 0 ) | 
This limit can also be written this way: 





,n + 1 1 


|a„ +1 (x 


-*o) 




" X o)"| 



lim — ; ~i ■ = |x - xj lim , " , = |x-x„|Z, 



So the series is said to converge absolutely for a particular x if | x - x 0 1 < l/L. 
The series diverges if |x-x„ | > l/L. And if lx-x 0 l = l/L, the ratio test is 
inconclusive and can't be used. 



In the large world of mathematics, there's a number that's either positive or 
zero, called the radius of convergence, p, such that the series converges 
absolutely if I x - x 0 1 < p and diverges if | X — Xq I > p. The region in which 
I x - x 0 1 < p in which the series converges is called the interval of convergence. 



Piutyqinq in same numbers 

The ratio test makes a lot more sense with numbers plugged into it. So in the 
following sections, I walk you through several examples. That way you can 
see for yourself just how useful this test is. 



Example 1 

Here's an easy example to begin with. Where, if anywhere, does the following 
series converge absolutely? 

2(-l)"(x-3)" 

The first step is to look at the limit of the ratio of the (« + l)th term to the 
nth term: 

lim -i ; -j — - 

— (-l)(x-3) 
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This ratio works out to: 
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(-1) (x-3) 
|(-l)"(x-3) 



|x-3| 



As you can see, the ratio is | x- 3 1 , and that ratio must be less than one. So 
the range in which the series converges absolutely is | x- 3 1 < 1, or 2 < x < 4. 
And the series diverges if x < 2 or x > 4. 

Example 2 

Ready for another example? Take a look at this series: 
y (x+l)" 

Zj A" 

n = 0 " 

Determine the radius of convergence and the interval of convergence for this 
series. To do so, first apply the ratio test, which gives you this limit: 



lim 



4" (x+l) 



4" +1 (x+l)" 



|x+l| 



As you can see, this series converges absolutely for |x+l| / 4<lor |x+l| 
< 4. So, in this case, the radius of convergence is 4, and the series converges for 
-5 < x < 3, which is the interval of convergence. That wasn't so difficult, was it? 

Example 3 

Here's a final example showing how to use the ratio test. Take a look at this 
series: 

fl (2x+l)" 



As always, you use the ratio test, like so: 
\(n+l) 2 \ |(2x+l)" +1 | 



lim 



(2x+ 1) 



1 



which equals: 



|2x+ II lim 



(n + iy 
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The limit evaluates to 1 as n -> <x>, so you get this: 



ipBooks 1 1 

or: 



\x + l /2\<'A 

The radius of convergence is Vi, and the interval of convergence is -1 < x < 0. 



Shifting the Series Index 




A method that can come in handy when working with differential equations is 
called shifting the series index. For example, say that you have this series, 
which starts at an index value of 3: 



2> 



If you want this series to start at n = 0 instead of n = 3, you can simply shift 
the index by 3, like this: 



Here's another example. Say that you have this series: 
2(" + 2)(x-x 0 )" 2 

And say that you want to shift this so only powers of n were involved, not 
n-2. You can make this shift by replacing the dummy variable n with n + 2, 
giving you: 

2(n + 4)(x-x 0 )" 



Taking a Look at the Taylor Series 



You can express continuous functions (those functions that don't take discon- 
tinuous jumps) as a series: the Taylor series. The Taylor series says that a 
function can be expressed as an expansion around a point, x 0 , like this: 
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In this series, n\ is n factorial, or n ■ (n - 1) • (n - 2) . . . 3 • 2 ■ 1. If a function 
has a Taylor series expansion at x = x 0 with a nonzero radius of convergence 
earlier section "The fundamentals of the ratio test" for more about 
as), the function is said to be analytic at x = x 0 . 



nas a layic 
^jjif\a^is 



A few types of Taylor series are especially important. Recognize this particu- 
lar series? 



2£ = «* 

It's your old friend e x \ 

Here's sin x: 

y (-l)V"*' 
h (2n+l)l 

And don't forget cos x: 



sinx 



(2n)! 



cos* 



Soitfinq Second Order Differential 
Equations With Power Series 

This section is all about tackling second order differential equations (which 
I introduce in Chapters 5 and 6) with power series. Say, for example, that you 
have a linear homogeneous second order differential equation like this: 

P(x)^ + Q(x)^+R(x)y=0 

Throughout the examples in this chapter, assume that P(pc), Q(pc), and R(pc) 
are all polynomials with no common factors. That's the easiest type of prob- 
lem to solve with power series. However, this method is also applicable when 
P(pc), Q(x), and R(pc) are general analytic functions, such as sin x or cos x. 

When working with power series, you divide the problems that fit the form 
of the previous equation into two types — those where you don't end up 
dividing by zero and those where you do. In this chapter, I focus on ordinary 
points. Ordinary points are points x 0 where P(x 0 ~) isn't equal to zero: 

P(x a ~) * 0 
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Because P(x) is continuous, it follows that there's an interval around x 0 in 
which P(x) isn't 0. Because P(pc) is a nonzero polynomial, you can divide by it 
: following (but remember that PQc), Q(x~), and R(x) have no common 



g + P (x)| + ? (,)y = fl 



where: 
p(x) 

and: 

q(x)- 



Q(x) 
P(x) 

R(x) 

P(x) 



This equation is the type that you're going to look at in the following sec- 
tions, and you're going to use ordinary points where nothing goofy happens 
(like functions suddenly going to infinity). In addition, you can impose initial 
conditions on this type of equation, such as: 



y(0) = c, 

and 



/(0) = Q 

Points where functions go to infinity are called singular points (you can take a 
look at those in Chapter 10). At singular points, P(x 0 ~) = 0, and at least one of 
Q(xq) and R(x 0 ~), isn't 0. So at least one of p(x) or q(pc) becomes unbounded as 
X — ^ Xo. In this chapter, the functions are much better behaved. 



So how do you solve second order differential equations using power series? 
The most basic way is to simply substitute a power series like this one: 

T,a„(x-x 0 )" 

into a differential equation. Then you can try to solve for the coefficients 
(which will be constants in this chapter). Because p(x) and q(x) are restricted 
to be polynomials in this chapter, working with power series will be even 
easier as you try to figure out the solution. 
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When you already know the solution 

^ |*^ ^^l^^^ 0 ^ at t ' lis secon d order differential equation: 



d y 

In your eagle-eyed solving mode, you no doubt recognize this equation to be 
a favorite among second order differential equations. You probably realize 
that the solution is: 

y = ctftQe) + c 2 y 2 (x) 

where: 

y t (x) = sin(x) 

and 

y 2 (x~) = cos(x) 

So you've solved the problem, but hold off crowing just yet, because you're 
going to tackle this problem using a power series. This problem is usually the 
first one you tackle, because you already know the solution, and you already 
know what sin(x) and cos(x) look like in terms of power series (see the ear- 
lier section "Taking a Look at the Taylor Series"). Here's sin(x): 



2n + l 



(2n+l)! 
And here's cos x: 

(-i)V" _ 



sinx 



2 



(2n) 



cos* 



You're ready to start solving your original differential equation using a power 
series of the following form: 



T,a n (x-x 0 )" 

n = 0 
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Centering the pouter series on a selected point 

Wken solving a differential equation using a power series, you first have to 
^el^t^)oint on which to center the power series (x 0 in the previous series). 
* IhV Vtfee of your original example equation, do what you'll usually do 
(unless there's a compelling reason otherwise): Choose x 0 to be 0. So your 
series will be an expansion of the solution around the ordinary point 0: 

2,a„x" 

n = 0 

Take a deep breath and then substitute this series into the original differen- 
tial equation you're trying to solve. To do so, you need to find the second 
derivative of the series. Keep reading to find out what to do. 

Finding the derivatives of a series 

How do you find the second derivative of a series? As you may have guessed, 
you work term by term. So you start off with a solution y of the following form: 

y=t,a n x" 

n = 0 

To find y", start by finding y'. Here's what the terms of the series look like: 

y = a Q + a^x + a 2 x 2 + a 3 x 3 + . . . 
So after differentiating term by term you get 

y' = di + 2a 2 x + 3a 3 x 2 + . . . 
The general nth term here is: 

na„x"~ l 
So y' equals: 

n = l 

Note that this series starts at n = 1, not n = 0 as the series for y does, because 
you took the derivative of the series. 

You can find y" by differentiating y' = a x + 2a 2 x + 3a 3 x 2 + . . . . You get this result 
fory": 

y" = 2a 2 + &a^c + . . . 
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The general term here is: 

l)a„x"- 2 

So you can give y" as the following: 
y" = Y,n(n-l)a n x"- 2 



Substituting pouter series into the differential equation 

The original differential equation looks like this: 

d 2 y 



dx- 



+ y=0 



So you can substitute the power series for y and y" to get this result: 
f>(n- l)a„Jc"- 2 +|>„x"=0 

n=2 n=0 

which is your differential equation in series form. 
Ensuring the same index Vatue 

To compare the series in the differential equation, make sure they start at the 
same index value, n = 0. You can shift the first series here by replacing n with 
n + 2 to get this result (I explain how to shift a series index in detail earlier in 
this chapter): 

±(n + 2)(n+l)a n+2 x"+±a„x"=0 

n=0 n=0 

When you do some simplifying, you get: 

2[( n + 2)(n+l)a„ +2 x"+a„x"] = 0 
You can factor out x" as well: 

2[(n + 2)(n+l)a„ +> + a.]jf"=0 
Believe it or not, you're making progress here. Seriously! 

Using the recurrence relation to find eVen coefficients 

Because the series shown in the previous section equals 0, and because it 
must work for all x, each term must equal 0. In other words, you get this: 

(n + 2)(n + l)a„ + 2 + a n = 0 
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which is called a recurrence relation. When you have a differential equation's 
recurrence relation, you practically have the solution in your pocket. Alright, 
; but the recurrence relation goes a long way. 



is case, the recurrence relation says that, for n = 0: 
(2)(l)a 2 + a„ = 0 

So: 



2 (2)(1) 
and for n = 2: 

(4)(3)a 4 + a 2 = 0 

So: 



(4)(3) 



Substituting a 2 from the first equation into the second equation gives you this 
result: 



4 (4)(3)(2)(1) 
But (4)(3)(2)(1) = 4!, so you get: 



a 

4 4! 



Similarly, for a 6 : 

(6)(5)a 6 + a 4 = 0 



or: 



6 (6)(5) 

Substituting for a 4 in terms of a 0 gives you: 



6 (6)(5)(4!) 
But (6)(5)(4!) = 6!, so you have: 

a =^ 
6 6! 
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To summarize, you have the following: 

a* 
21 



4 4! 

a 

6 6! 

So now you can relate the even coefficients in general. If n = 2m (in which m 
stands for a positive integer or zero): 

(-l) m ao n 1 o o 

a„=a 2m = ^ m = 0,l,2,3... 

Because you set a 0 based on the initial conditions for a given problem, you 
can now find the even coefficients of the solution. 



Usinq the recurrence relation to find odd coefficients 

Now you can move on to the odd coefficients. Turn back to the recurrence 
relation in the previous section for the solution: 

(n + 2)(n + l)a„ t2 + a n = 0 

You can see that for n = 1 you get: 

(3)(2)a 3 + a, = 0 

So: 

Q3= (3)(2) 

Taking a clue from the even coefficients in the previous section, you can see 
that (3)(2) = 3!, so you get this: 

= ZSi 

Now, for n = 3 in the recurrence relation, you get: 
(5)(4)a 5 + a 3 = 0 



or: 



Q5= (5)(4) 
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Substituting a 3 in terms of a x into this equation gives you: 



DropBooks 

or: 



(5)(4)(3!) 



Q5= 5! 

Substituting n = 5 into the recurrence relation gives you: 
(7)(6)a 7 + a 5 = 0 

or: 

-a. 



a, 



7 "(7)(6) 

And substituting a 5 into this equation gives you: 



-a, 



7 (7)(6)(5!) 
which means that: 

To sum up, the odd coefficients you have so far are: 

_ ~ a i 
a3 "~3T 

a i 

Q5= 5! 

So now you can relate the odd coefficients of the solution this way in general, 
if n = 2m + 1: 

Q n = Q2 m+1 = (2m+TTl m = 0,l,2,3... 
Putting together the solution 

Using the two equations for even and odd coefficients from the previous sec- 
tions, you get the following general solution to your differential equation in 
series terms: 
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y=a 0 2 
t 



(-i) * 2 

(2m)! 

(-l) m jc 2m+ 
(2m + 1)! 



That's the solution to the differential equation in series terms. In this case, 
the two series are recognizable as cos(x) and sin(x). Here's sin(x): 

v (-i)V" +1 • 

h {2n+\)\ smx 

And here's cos x: 

f, (-l)V" 

h (2n)\ COSX 

So you can rewrite the solution as: 

y = a 0 cos(x) + a x sin(x) 

The terms a 0 and ai are arbitrary constants (just like c 0 and Ci), and they're 
set by matching the initial conditions. 



When you don't knout the 
solution beforehand 

How do you use a power series to solve a differential equation for which you 
don't already know the solution? For instance, what if you have an equation 
like this: 



Give it a try, using a power series like this: 
y=t,a„x" 

n = 0 



The following sections will guide you through the process. 



Differentiating and substituting pouter series 
into the differential equation 

Differentiating the power series from the previous section gives you the fol- 
lowing equation: 



n = l 
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And differentiating this gives you: 
n(n-l)a n x- 2 



Now for the fun part: substitution! Substituting these equations into the origi- 
nal differential equation gives you this result: 

i>( n -l)a„*"- 2 

n = 2 

-xj]na n x nl 

n = l 

+ 2|]a„x"=0 




Using the recurrence relation to find coefficients 

Now it's time to equate powers of x on the left side of the equation to 0 on the 
right side. Combining the coefficients for powers of x gives you this equation: 

[2a 2 + 2a 0 ] + [6a 3 + x + I2a 4 x 2 + [20a 5 - a 3 ] x 3 . . . 
+ [(n + 2)(n + 1) a n+2 - (n - 2)a„ ] x" = 0 

Note that every power of x must be 0 for the equation to work, so the last term 
in the previous equation gives you the recurrence relation for this solution: 

(n + 2)(n + 1) a m2 - (n - 2)a„ = 0 

After some simplifying, you get: 
(n-2) a. 



a n+2 



(n + 2)(n + l) 



That doesn't look so bad. This equation gives you these values for the coeffi- 
cients when you plug in for n: 

a 2 = -a 0 
a 4 = 0 

1 3 

a ==20 Q 

Substituting a 3 in terms of ai into the previous equation gives you the 
following: 



1 



1 



° 5 20 ° 3 120 Ql 
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Here's a 6 : 

2 
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30 ° 4 



And substituting a 4 into this equation gives you: 

Keep going! Here's a 7 : 

a 7 =^a 5 
Or, to simplify: 



Substituting a 5 in terms of a t into this equation gives you: 
1 „ 1 ("1 

"7 = 

So 



Q? 14 a " 14 120 Ql 




7 1,680 

How about a 8 ? Here's what you get: 

But you know that a 6 = 0, so: 

a 8 =^a 6 =0 

In fact, because a 4 = 0, all subsequent even coefficients must be 0 by the 
recurrence relation: 

(n-2)a„ 
a " +2 (n + 2)(n + l) 

Putting together the solution 

Because all the even coefficients are 0 beyond a 2 , life is a little easier. You just 
need to plug in the odd coefficients to get the entire solution to the differen- 
tial equation. Here's what you have for the solution: 

y=a 0 +a 1 x-a 0 x 2 
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Grouping terms together by their coefficients gives you: 

D ropBook^^-^ aiX 3_^ aiX 5__^_ aX 7 + j 

If you define the following: 

y. = 0-* 2 ) 

and: 

y 1= ( x -l ai x*-T± s a l x'- T ± S5 a i x 1 +..!} 

then you can see that the general solution is: 

y = a a y x + atf 2 

A famous problem: Airy's equation 

Before you wrap up the chapter, take a look at one more differential equation. 
Get ready, though. It's a famous one! In fact, it even has its own name — 
Airy's equation. Here's what it looks like: 

y"-xy= 0 

To solve this equation, you can assume, as you do earlier in this chapter, that 
the solution is of the following form: 

y=T,a„x" 

n = 0 

I explain the rest of the process in the following sections. 

Differentiating and substituting pouter series 
into the differential equation 

As always, be sure to start off by differentiating the equation. Doing so 
gives you: 

/=^>a„x'- , 

71 = 1 

After differentiating this equation one more time, you get: 
y"=f,n(n-l)a n x"- 2 

n = 2 
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Who was Airy? 



5on 



'Airy (1801-1892) was an 
English mathematician and astronomer. In fact, 
he was the Astronomer Royal from 1835 to 1881. 
He was a man of many achievements. For 
instance, he found planetary orbits, measured 



the Earth's density, and came up with a solution 
of two-dimensional problems in mechanics. 
He's also the one responsible for establishing 
Greenwich in Britain atthe location of the prime 
meridian. 




Plugging the derivatives into the original differential equation gives you this 
result: 

|]n(/7-l)a„x"- 2 -xI]a„x"=0 

n-2 n=Q 

With some simplifying you get: 

i>(n-l)a„x"- 2 -2>„x" +1 =0 

n-2 n=0 

You can also write this equation as: 

Y 1 n(n-X)a n x"~ 1 -Y 1 a n x"+ l 

n = 2 n=0 

Ensuring the same index i/afue 

Now you need to compare the coefficients of equal powers of x on the two 
sides of this equation to find the recurrence relationship. To compare those 
coefficients, it helps to make sure that the powers of x are the same in each 
series. 

Compare the coefficients in terms of x". Shifting the series on the right (as I 
show you earlier in this chapter) gives you this result: 

%n(n-l)a m x'- t -£a„_ 1 x' 

n=2 n=l 

You can also shift the series on the left by substituting n + 2 for n, which 
gives you: 

t,(n + 2)(n+l)a„ +2 x"=±a„_ 1 x" 
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Using the recurrence relation to find coefficients 

you're ready to compare coefficients of powers of x. Note from the previ- 
ion that the series on the left starts at n = 0 and the series on the 
rts at n = 1; to compare the terms, it's easier if the series starts at the 
same value, say n = 1. You can break the first term out of the series on the left 
to make the initial values of the indexes of the two series match, like this: 

2a 2 +2(n + 2)(n + lK +2 x"=i]a„_ 1 x" 

|? = 1 n = l 

Note that the left side of this equation has a constant term, 2a 2 , but the right 
side doesn't. So right off the bat you know that a 2 = 0. 

Because the two sides of this equation must be equal in their terms, you get 
the following for the recurrence relation: 

(n + 2)(n + l)a nt2 = a n -\ n = 1, 2, 3, 4 . . . 

The coefficients are determined in steps of three because if you know a n _ u 
you can get a n + 2 . That is, when you have a 0 , you know you can get a 3 , a 6 , a 9 , 
and so on. And when you have a lt you can get a 4 , a 7 , a w , and so on. Because 
you already know that a 2 = 0, you know that a 5 = 0, a 8 = 0, a n = 0, and so on. 

Start with the sequence o 0 , a 3 , a 6 , a 9 , and so on. And remember that a 0 and a x 
are set by the initial conditions. This means that you should start with a 3 . 
Here's a 3 in terms of o 0 : 

n = Q ° 

(2)(3) 

Here's a 6 : 

Substituting a 3 in terms of a 0 into this equation gives you: 

a6= (5)(6K°2)(3) 
Here's a 9 : 

a. 



(8)(9) 

Substituting a 6 into this equation gives you: 



(8)(9)(5)(6)(2)(3) 
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(2)(3)(5)(6) . . .(3n - 4)(3n - 3)(3n - l)(3n) 



n= 1,2,3 . . . 



Now look at the sequence a u a 4 , a 7 , a 10 , and so on. Because is set by the ini- 
tial conditions, you should start with a 4 : 



4 "(3)(4) 
Here's a 7 : 

a. 



7 (6)(7) 

Substituting a 4 in terms of ai gives you: 

= Qi 
Q7 -(6)(7)(3)(4) 

And here's a w : 

a 7 

Ql ° (9)(10) 
Substituting a 7 into this equation gives you: 

ai ° = (9)(10)(6)(7)(3)(4) 
So you can say that in general: 



7+1 (3)(4)(6)(7). . .(3n-3)(3n-2)(3n)(3n + l) 



n = 1,2,3 . . . 



Putting together the solution 

After you get through with all the previous steps, you'll know that you can 
write the general solution to Airy's equation like this: 



y=a 0 



1 + 4^ + t^ + 



6 180 ••• (2)(3)(5)(6)...(3n-4)(3n-3)(3n-l)(3n) 



a, 



12 504 



' (3)(4)(6)(7). . .(3n-3)(3n-2)(3n)(3n + l) 
You can write this in the following shorter form: 



y=a 0 

<2l E 



1 + 2 



x' 



(2)(3)(5)(6) . . .(3n- 4)(3n - 3)(3n - l)(3n) 



(3)(4)(6)(7). . .(3n-3)(3n-2)(3n)(3n+ 1) 
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So if you write: 

x 1 



fcj (2)(3)(5)(6). . .(3n-4)(3n-3)(3n-l)(3n) 

and: 



y ' ?„ (3)(4)(6)(7)...(3n-3)(3n-2)(3n)(3n + l) 
you can see that the general solution to Airy's equation is: 

y = a 0 yi + a x y 2 
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In This Chapter 

Perusing singular points 
Examining Euler equations 

Surveying series solutions near regular singular points 



f 

■ n Chapter 9, 1 briefly introduce you to the concept of singular points, but 
«C this chapter is where the real action is. I cover a number of topics, includ- 
ing working with Euler equations, handling power series solutions near singu- 
lar points, and dealing with a mix of the two — series solutions to Euler 
equations near singular points. 



Pointing Out the Basics of 
Singular Points 

In this chapter, you work with second order homogeneous differential equa- 
tions of the following form: 

P(x)^ + Q(x)^ + R(x)y=0 

where PQc), QQc), and R(x) have no common factors. 

You can also divide each term in the equation by PQc) to get: 

d 2 y i \ dy . , _ 

where p(x) = QQx)/PQx) and q(x) = R(x)/P(x). 
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So far, so good, right? Not so fast! Now I'm going to throw singular points into 
the mix. Points where functions go to infinity are called singular points. At sin- 
its, P(xo) = 0, and at least one of Q(x 0 ) and R(x 0 ~) isn't zero. So at least 
k) or q(x) becomes unbounded (goes to infinity) as x — > x 0 . 
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In the following sections, I introduce you to the fundamentals of singular 
points, including how to find them, how they behave, and the difference 
between regular and irregular points. 



Finding singular points 



Time to get your feet wet! What are the singular points of the following differ- 
ential equation? 

(4 -^)g + ^^ + (1+x)y = 0 

The singular points are where P(x) = 0, so you have: 
(4-x 2 ) = 0 

Simply use your excellent algebra skills to solve this equation, and you find 
that the singular points are x = ±2. 

As another example, determine the singular points of this differential equation: 

x 2 g + (8-x 3 )^ + (l-9x)y=0 
Here, P(x) is simply x 2 . So the singular point is x = 0. 



The behavior of singular points 

When studied closely, singular points look like they have the potential to 
become unruly. After all, singular points are where a solution may go to infin- 
ity or change rapidly in magnitude. If you're asking whether you can simply 
ignore them, the answer is no. 

Why? Because solutions to differential equations with singular points vary so 
much near those singular points that you need to take special care. In fact, 
it's often the case that the solution to a differential equation is the most inter- 
esting around its singular points. That's where the most interesting physics 
goes on. For example, an electrical circuit may reach resonance there. And 
reaching resonance is often the whole point of amplifying circuits, so ignoring 
the behavior at singular points just wouldn't do. 
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For example, take a look at this second order homogeneous equation: 
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2y = 0 



By using your unbeatable differential equation solving skills, you can tell that 
the two independent solutions to this differential equation are: 



yi=x 



and 




y 2 = x~ 

The yi solution is fine — its behavior is well-defined around x = 0, for exam- 
ple. In fact, the yj solution is still analytic (meaning that it has a working 
Taylor expansion; see Chapter 9 for more about Taylor series) as x — > 0, even 
though the differential equation looks like this if you divide by PQx): 



dx 2 x 2 



o 



This equation looks unbounded as x — > 0, but everything is okay if you substi- 
tute y x = x 2 here. 

The situation is different with y 2 = x~ (also written as 1/x), however. This solu- 
tion isn't analytic at x = 0 (in other words, it has no Taylor expansion at x = 0). 
So you can't use the methods of Chapter 9 to solve this differential equation. 

As you find out in the next section (and throughout this chapter), different 
kinds of singular points exist — and all of them have varying levels of man- 
ageability. It is often the case that you can't use the Taylor expansion used in 
Chapter 9 to solve differential equations with singular points, because those 
expansions become unbounded at the singular points. Because of this, you 
have to use more general expansions from time to time. 




Regular Versus irregular singular points 

An important concept when it comes to singular points is severity. A singular 
point's severity is an indication of how strong the singular point is — how 
strongly it tends toward infinity. The severity of a singular point has a lot to 
do with how you handle the solution; does the solution, for instance, include 
terms like 1/x, or does it include terms like 1/x 8 ? (It turns out that you can 
handle 1/x in most cases, but 1/x 8 ? Good luck with that one.) The idea is to 
extend the techniques of Chapter 9, which allow you to use series expansions 
near ordinary points, to help you use series expansions near singular points — 
if they're well-behaved enough. 
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What's th 



A well-behaved singular point is called a regular singular point. Regular singu- 
lar points are well-behaved enough that you can handle them using the tech- 
this chapter. 





What's the definition of a regular singular point? They're defined in terms of 
the ratio Q(x~)/P(pc) and R(x~)/P(x~), where P(x), Q(x~), R(x) are the polynomial 
coefficients in the differential equation that you're trying to solve: 

P(x)^ + Q(x)^ + R(x)y = 0 

In order for x 0 to be a regular singular point of this equation, these two rela- 
tions have to be true: 



and 



lim (x — x„ 



lim (x-x n 



P(x) 



*(*) 

P(x) 



remains finite 



remains finite 



Another way of thinking about this is to say that x 0 is a regular singular point 
if (x - Xo)Q(x)/P(x) and (x - x 0 ) 2 Q(x)/P(x) have Taylor expansions (that is, 
they're analytic) around x 0 . 

As you may have guessed, if singular points aren't regular, they're irregular. 
And irregular singular points are much more — shall I say interesting? — to 
handle. 

Take a look at some example differential equations to see if their singular 
points are regular or irregular. 

Example 1 

Start with this differential equation (which you just saw in the previous 
section): 

dx 2 x 2 U 
The solutions for this equation are: 



yi=x 



and 



y 2 = x 
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There's a singular point at x = 0 because y 2 becomes infinite. Now take some 
time to evaluate the relations: 
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, Q(x) 
x a -ft, — r remains finite 
' P(x) 

and 

,. / \ 2 R ( x ) . c . . 

hm [x-xA -jjT — r remains finite 

You test the first relation by plugging in some numbers, like so: 
lim(X)f = 0 

x - 0 1 

And because 0 is finite, you're okay so far. Now for the second relation, 
R(x)=-2/x 2 andPQc) = 1: 

lim (x) 2 =|= -2 

Because -2 is finite, x = 0 is a regular singular point of your original differen- 
tial equation. Cool, huh? 

Example 2 

Now try this one: 

(x-4) 2 ij + te| + (x-4)y=0 

What are the singular points in this equation? Are they regular? Here, P(x) = 
(x - 4) 2 x, and that's 0 at x = 0 and x = 4. So x = 0 and x = 4 are your singular 
points. Start with the x = 0 singular point first; here's what the first relation 
has to say about it: 

lim(x) ^i— = ! 

^° (x-4) x 4 

Because % is finite, you're good to go. Now for the second relation: 

lim(x) 2 {X ~ 4 ) =0 
(x-4) x 

Zero is finite, so the x = 0 singular point is a regular singular point. 

So far, so good. Now, however, you have to try the other singular point, x = 4. 
The first relation gives you: 

lim ( x - 4) — 2 > , 4 is NOT FINITE 

(x-4) x (x-4) 



218 P art "' : The Power Stuff: Advanced Techniques 



DropBooks 



Whoops — this relation is unbounded as x — > 4, so x = 4 isn't a regular singu- 
lar point. In other words, it's an irregular singular point. 



3 

Try your hand at this equation, which is a famous one, the Legendre equation 
(see the nearby sidebar "Discovering the legacy of Legendre" for more on the 
man who unearthed this famous equation): 

(1 " x2 )§" 2 *ll + a(a+1)y=0 

where a is a constant. Because PQc) = (1 - x 2 ), the singular points are jc = ±1. 
Look at the x = 1 point first. From the first relation and because (1 + x)(l - x) = 
(I-* 2 ): 

lim (x- 1) j- 2x1 2 , = ~ 2 *\ = -1 
v ' (1 -x 2 ) (1 +x) 

As you know, -1 is, of course, finite. 

Now for the second relation: 
oc(oc+ 1) 




lim (x- 1) 



1-x 2 



This equation can be broken down to: 

2 oc(a+l) 
lim(x-l) -p. — -xr. — 
v ; (1 -x)(l +x) 

which is: 

lim -(x- 1)^^ = 0 

x~l V ' (1+X) 

Because 0 is finite, x = 1 is a regular singular point. 

Now try the other singular point, x = -1. Here's what the first relation gives you: 

lim (x+ 1) 2x = = -1 

*— i (1 -x ) (1 -x) 

As you know, -1 is finite. Now check out the second relation, which gives you: 
. ,.j a(a+ 1) 
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covering the legacy of Legendre 



TariW-lvTaTie" LecfeTidre (1752-1833) was the 
French mathematician who discovered the ever- 
important Legendre equation. His work was done 
in the fields of statistics, abstract algebra, math- 
ematical analysis, and number theory. He was 
born to a rich family, and studied physics in Paris. 
Then he took up teaching at a military academy. 
He took on this job because he enjoyed it, not 



because he had to. He started publishing works 
on physics — specifically on the motion of 
cannonballs — but then moved on to math. In 
1782, he became a member of the French 
Academy of Sciences. He even got a crater on 
the moon named after him. How many mathe- 
maticians can say that? 



You can also write this as: 
,. , 1X 2 a(cc+l) 

lim(x+l) 73 777. 7 

* — 1 V ; (1 -x)(l + x) 



or: 



a(a+ 1) 
hm (x+ 1) -A r 1 

x->-l v ' (1 -X) 



The limit is: 



a(a+ 1) 
hm x+ 1) ^ = 0 

x—-l v ' (1 -x) 



Because 0 is finite, x = -1 is also a regular singular point. 



Exploring Exciting Euter Equations 

A good way to understand how to handle regular singular points is to see 
how one of the most famous differential equations — which has a regular sin- 
gular point — is handled. The equation I'm talking about is Euler's equation: 



2 d 2 y dy „ _ 
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Here, a and P are real constants. If you assume that the solution to this equa- 
tion has the following form: 





(where r is a constant), substituting the solution into the equation gives you: 

[r(r-l) + ar+|3]x r =0 
Dividing both sides by x' gives you: 

r(r- 1) + ar + |3 = 0 

or: 

r 2 -r+ ar+P = 0 

So: 

r 2 + (a - 1) r + p = 0 
The roots, r x and r 2 , of this equation are: 

_ -(q-l) + y(q-l) 2 -4p 
r " r2 2 

Because you're considering the general Euler's equation, you don't know 
what a and P are, so you have to consider three cases for these roots: 

r x and r 2 are real and distinct 
r, and r 2 are real and equal 
V rj and r 2 are complex conjugates 

In the following section, you consider each of these cases separately. 

Euler was a pretty busy guy; he also came up with Euler's method, which is a 
simple numerical method of solving differential equations. Flip to Chapter 4 
for details. 



Real and distinct roots 



If the roots of r 2 + (a - 1) r + P = 0 are real and distinct, r x t r 2 . The general 
solution to Euler's equation is: 

y= Cj x r, + c 2 x' 2 
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To see how to come up with this solution, try solving this differential equation: 
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d y „ dy „ _ 
-t4 + 6x -j- - 2y = 0 
dx 2 dx J 




This equation has a regular singular point at x = 0, and you can assume that 
the solution is of the following form: 

y = * r 

Substituting this solution into the original equation gives you: 
[4r(r-l) + 6r-2]x r =0 

or: 

[4r(r-l) + 6r-2] = 0 
After some simplifying, the equation looks like this: 

4r 2 + 2r-2 = 0 
Factoring gives you: 

2(2r-l)(r+ 1) = 0 
So the roots are: 

r 1 = X 
and 

r 2 = -l 

This means that the general solution to the original equation is 

y = Ci x'' + c 2 x" 1 

Note how this technique is similar to the one in the situation where the differ- 
ential equation you're dealing with has constant coefficients (as in Chapter 5) 
and you assume a solution of the form y = e rx . Here, there are powers of x 2 and 
x already appearing in the coefficients of the differential equation, so you 
assume that the solution is of the form y = x r . 
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Real and equal roots 



( es the two roots of r + (a - 1) r + (3 = 0 are equal. For example, take a 
is differential equation: 



d 2 y 



dy 



~ dx 2+3x dx +2y= ° 
Substituting y = x r into this equation gives you: 
[r(r-l) + 3r+2]x r = 0 

or: 

r(r- 1) + 3 r+ 2 = 0 
After some simplifying, this becomes: 

r 2 + 2r+2 = 0 
which in turn becomes: 

(r+ l)(r+ 1) = 0 

So the roots here are -1 and -1. How do you handle a case like this? Clearly 
yi = x' 1 , but what's y 2 l 

As you find out in Chapter 5, when you have a second order differential equa- 
tion with constant coefficients, you try a solution of the following form: 

y = e' x 

After you substitute this solution into the differential equation, you may find 
that the two roots, r x and r 2 , are equal. In that case, you end up with these two 
solutions: 



and: 




y 2 = xe ■ 

Is there an analog for Euler equations? You bet. If r x = r 2 , then: 

y x = x'> 
And in that case: 



y 2 =\n(x)x r ' 



Chapter 10: Powering through Singular Points 



So the general solution of Euler equations with equal roots of the characteris- 
tic equation is: 

oks 

And that's it. The solution to your original equation is: 
y = C! x" 1 + c 2 ln(x) x -1 



Complex roots 



In this section, you take a look at the case where the roots of a Euler equation 
are complex and of the form a ± ib. In this case, a and b are constants, and /' is 
the square root of -1. Your solutions look like this: 



and: 



y 2 =x a -' b 



To deal with complex roots, you have to get into some trigonometry. Start by 
noting that this is true: 



And note that as long as x > 0: 



and this equals: 



x>0 



x>0 
which is: 

e ,ta e /ita = ^g/ita X>Q 

Whew! At this point, you can use the following relation: 

e™ = cos mx + i sin mx x > 0 

Here, m is a constant. So after using the relation, your equation becomes: 

x"e ,blnx = x Q [cos(Wn(x)) + i sin(f>ln(x))] x > 0 
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Absorbing the pesky factor of /' into c 2 gives you the general solution, which 
looks like this: 



oks 



x"cos(bln(x)) + c 2 x a sin(foln(x)) x > 0 



Now try putting all this trig to work with an example. Try solving this Euler 
equation, where all the coefficients are 1: 

2 d 2 y dy 
x —tt + x -T- + y = 0 
dx 2 dx J 



Trying a solution of the following form: 

y = x r 
gives you: 

[r(r-l) + r+ l]x r = 0 

or: 

r(r- 1) + r+ 1 = 0 
After some simplifying, this equation becomes: 
r 2 + l=0 

Uh oh! The roots here are complex: ±r. This means that a = 0 and b = 1, so 
you get: 

y = Cj cos(In(x)) + c 2 sin(ln(x)) x > 0 

This equation is only valid for x> 0. Let me guess: You're wondering whether 
you can do anything for x < 0. Well, actually, it can be shown that this is the 
way to handle the regions x < 0 and x > 0 (not x = 0): 

y = CiCos(ln Ixl) + c 2 sin(ln Ixl) x>0 

j ^b« Putting it alt together With a theorem 

The following formal theorem summarizes the previous sections: 



If you have a Euler equation: 

, d 2 y dy „ 
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where a and p are real constants, then the solution is of this fundamental 
form in any interval that doesn't include the origin: 



where you can find r by solving the characteristic equation: 

r(r+l) + ar+P = 0 
If the roots are real and distinct, then the general solution is of this form: 

y=c l \x\ r ' + c 2 \x\' 2 

If the roots are real and equal, then the general solution is of this form: 

y=c 1 \x\ r ' + c 2 ln\x\\x\ r ' 

And if the roots are complex, a ± ib, then the general solution is of this 
form: 

y = Ci | x |"cos(6 In | x | ) + c 2 1 x |"sin(6 In | x |) 

Figuring Series Solutions Near 
Regular Singular Points 

In the following sections, you take a look at how to find the series solution 
near regular singular points. Have fun! 

Identifying the general solution 

Take a look at the general second order differential equation that you want to 
solve: 

p(x) S +Q(x) ^ +jR(x)y=o 

You can assume that the solution has a regular singular point. For conve- 
nience, you can also assume that the singular point is at x 0 = 0. (If the singular 
point isn't at zero, you can make a substitution of variables, x -> x - c, where 
c is a constant, so that it is). 
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where: 



Divide this equation by P(x) to get: 

d 2 y i \ dy / \ n 



p{x) 



and: 



q(x) 



P(x) 



R(x) 
P(x) 



From here, with a few tricks up your sleeve, you can decipher a general solu- 
tion near singular points, as you find out in the following sections. 

Seeing the series of products 

Because x = 0 is a regular singular point, it follows that x p(x) and x 2 q(x) both 
have finite limits as x — > 0. This means that both products have convergent 
series of the following form (see Chapter 9 for an introduction to power series): 

xp{x) = Y 1 p n x" 




and: 

x 2 q{x) = Y 1 q„x" 

n = 0 

Both series converge for \x\ < a for some interval, a > 0. 



Substituting the series into the differential equation 

Now multiply the original differential equation by x 1 to get the following 
equation: 



* 2 ihF +x [ x p( x )] ^ +x2 i( x )y =0 



dx 

Substituting the two series from the previous section into this equation gives 
you this result: 

x 2 ^ 
dx 2 

+x[p 0 + p l x + p 2 x 2 + . . .+p n x"+. . .} & 
+ [q 0 +q l x+q 2 x 2 + . . . + q„x n + . . .]y = 0 
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Recognizing a Euler equation 

The previous equation looks a little difficult. But don't worry. Here's what to 
ickling problems of this kind by assuming that all coefficients except 
fare equal to 0. Doing so in the case of the example gives you: 




2 d 2 y 

X ^T+*Po 



dy 

dx 



Does this equation look familiar? It should — it's a Euler equation, like the 
ones I discuss earlier in this chapter. The fact that this looks like a Euler 
equation helps you see how to tackle the more general differential equation 
with a regular singular point. 

Here's the key: If not all the coefficients (besides p 0 and qo) are equal to 0, you 
have to assume that the solution is of this Euler-like form: 



y = x r T,q n x" 



This series is the same as this one: 



y=T,QnX" +r 




The fundamental solution is a Euler solution, with the power series added in 
to take care of any non-Euler coefficients. In other words, even if your differ- 
ential equation has a regular singular point, you can sometimes find a valid 
solution of the form of this power series in the region of the singular point. 



The basics of solving equations 
near singular points 

Before I get to a numerical example, I want to walk you through the steps of 
solving an equation near singular points. The following sections show you 
everything you need to know. Fasten your seat belt! 

determining the solution's form and differentiating 

Say you start with a differential equation of the following form: 

x*^-x[xp(x)]& + [x*q(x)]y=0 
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and: 



where: 
and: 

x 2 q(x) = Y l q„x n 

n = 0 

Here's the Euler equation that matches the differential equation: 

2 d 2 y dy 

As you find out in the earlier section "Recognizing a Euler equation," you can 
assume that a solution to this equation is of the following form: 

y=x'T,q„x" 

n = 0 

This solution is the same as the following: 

y=2<7„*" +r 

n = 0 

Differentiating this series gives you: 
% = ±a n (r + n)x— 1 

UJL n = 0 

And after differentiating again you get: 
J = |a.(r+ n)(r + n-\)x—> 

Substituting series into the original equation 

Now it's time for the heavy-lifting. Substituting the previous three series 
into the original differential equation and collecting terms gives you this form 
of the differential equation: 



aJ{r)x r +Y> 
where: 

f(f) = r(r + 1) + p 0 r + q a 

and 



n-l 

f(n + r)a„+ 2 aJ(m + r)p„_ w + q„_ w ] 



x n+r =0 



Po=lim xp(x) 
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and 

lim x 2 q(x) 

Wow. What do you do next? Read on to find out. 



Finding the indiciai equation 

You know that in order for the terms on the left side of the previous equation 
to equal zero, every power of x must equal zero. In particular, note that this 
means: 

a 0 f(f)x r = 0 

Because a 0 and x r aren't zero, you know that: 

Kf) = o 

When this equation is expanded, you get the following: 

r(r + 1) + p 0 r + q 0 = 0 

This equation is the indiciai equation for the original differential equation; 
in other words, it's the same characteristic equation for the roots you'd get if 
you solved the differential equation's corresponding Euler equation. 

Working With the roots 

You use the two roots of the indiciai equation to find the two solutions to the 
differential equation, y x and y 2 . 

Next, you can set the coefficients of x"* r to zero in the previous section's 
equation. Doing so gives you this relation: 

n-l 

f(n + r)a„ + 2 a m \(m + r)p„_ m + q„_J = 0 n> 1 
which gives you the following recurrence relation (see Chapter 9 for details): 

n-l 

-T,a m \(m + r)p n _ m +q n _ m ] 

a„=— — —r, v n>\ 

f(n + r) 

You can then find the coefficients, a m from this recurrence relation. 

There are two solutions to the original differential equation, each of which 
corresponds to the two roots, r x and r 2 . Here's the first solution, y x : 
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So how do you go about finding the second solution, y 2 l Well, how you do 
that depends on the two roots of the indicial equation. (See the later section 
closer look at indicial equations" for details.) 



A numerical example of solving an 
equation near singular points 

The stuff in the previous sections can be tough, so take a look at a numerical 
example to make it all clear in your mind. 

Uncovering the solution's form 

To start, take a look at this differential equation: 

2x 2 ^-x ^- + (\+x)y=0 
dx 2 dx v > J 

This equation has a regular singular point at x = 0. How would you find a solu- 
tion to this equation? Well, after you give it some thought, it looks a lot like 
this Euler equation: 

2jc ^_ x |y o 

dx 2 dx J 
So you can try a solution of the following form: 

y=f 1 a„x^' 

n = Q 

Differentiating this solution gives you: 

After differentiating again, you get: 

^ = ±a„(r+n)(r+n-l)x— 2 

CLX n = 0 

Using series as substitutes in the original equation 

Substituting the previous three series into your original differential equation 
gives you this impressive result: 
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n = 0 
n = 0 

This equation can also be written as: 
a 0 [2r{r-\)-r+\]x r 

+ t t ([2(r+n)(r+n-l)-(r+n) + l}a n + a„_ 1 )x r *"=0 
Wow. Can you decipher this? Keep reading to find out! 
Unearthing the indicia! equation 

Because the coefficients of all powers of x in the previous equation must be 
zero for the whole equation to be zero, you can set the coefficient of x r to 
be zero, like so: 

2r(r- l)-r+ 1 = 0 

Multiplying this out gives you the following equation: 

2r 2 - 3r + 1 = 0 

This turns out to be the same characteristic equation you would have 
received from the Euler equation that's closest to the equation that you're 
trying to solve, namely: 

n 2 d 2 y dy _ 
2x -rr-x -jr +y= 0 
dx 2 dx J 

You can factor 2r 2 - 3r + 1 = 0 into the following indicial equation: 

(r- l)(2r- 1) = 0 
As you can see, the roots of this equation are: 
r, = l 

and 



r 2 = V2 
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These two roots are given a big name: exponents at the singularity. They're 
given this name because they describe the behavior of the solution near the 
^^rjg^l^^joint, x = 0. You put these roots to work in the next two sections. 

Getting back to the original differential equation in impressive series form, 
you now set the coefficients of x r * n equal to zero to get this: 

[2(r + ri)(r + n - 1) - (r + n) + 1 ]a n + a n _x = 0 

You can rewrite this equation as: 



2(r+n) -3(r+n) + l 

Or, with some regrouping you get: 

a = Z£°=i 

" [(r+n)-!][2(r+n)-l] 

For each root of the initial equation, r x and r 2 , you can use this recurrence 
relation to find the coefficients a n . Keep reading to find out what to do next! 

Applying the first root 

Plugging the first root, r x = 1, into the recurrence relation gives you: 



" n(2n+l) 
So when you plug in 1 for a, you get this: 

a 

a, 3 

And when you plug 2 in for a you get this: 

Q2= (5)(2) 

Substituting a, into this equation gives you: 
-a„ 

a, 



(5)(2)(3) 
Now here's the next coefficient: 

-a, 

a, 



(7)(3) 

Substituting a 2 into this equation gives you: 
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You can rewrite this equation as: 

'0ks (3)(5)(7) ^ )(2)(3) 

In general, you get this relation: 

(-1)"Qo 
a ""[(3)(5)...(2rt+l)] n ! 

which means that y t of the general solution is: 



£i [(3)(5). . .(2n+l)]n! 



x>0 



Here's the million-dollar question: Does this series converge? As you may 
expect, you can use the ratio test to find out (see Chapter 9 for details): 



lim 



a„x 



which works out to be: 



lim 



(2n + 3)(n+l) 

And as n — > <*>, this limit — > 0, so the series expansion is valid for all values of x. 
Plugging in the second root 

Now how about r 2 = V-P. To work with the second root, turn back to the follow- 
ing recurrence relation: 

-a„_, 



a "~[(r + n)-lp(r+n)-l} 
Plugging mr=Yi gives you: 
-a.-, 



1 



[2n] 



which equals: 
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As you may know, a 0 is arbitrary and is set to match the initial conditions of 
the problem. So you start by finding a^. 



So: 

ax = -a 0 
Now for a 2 : 



a, 



(3)(2) 



Substituting a, into this equation gives you the following result: 

a = Es 

2 (1)(3)(1)(2) 

And for a 3 : 

Q3= (3)lt) 

Substituting a 2 into this equation gives you: 

° 3= (1)(2)(3)0)(3)(5) 
And for a 4 : 

-a, 



4 (4)(7) 

Substituting a 3 into this equation gives you: 

° 4 (1)(2)(3)(4)(1)(3)(5)(7) 
So, in general: 

(-l)"a, 



nl(l)(3)(5)(7)...(2n-l) 
You can give the second solution, y 2 , like this: 

(-i)V 



1 + 2 



^x[(l)(3)(5)...(2n-l)/i!] 



x> 0 
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How about the radius of convergence? To find out, you can use the ratio test 
as vou did in the previous section: 



Ol 



After some simplification, this equation can be rewritten as: 



lim 



(2n-\)n 

Congratulations! Now you know that the series converges for all x. 



Taking a closer took at indicial equations 

In the numerical example in the previous section, there were two real and dis- 
tinct roots to the indicial equation (the equation you would get if the differen- 
tial equation were an Euler equation). So you got two distinct solutions, y x 
and y 2 . The general solution is: 



y = dyi + c 2 y 2 



What happens if the indicial equation's roots are the same — that is, real and 
equal? In that case, the first solution is of the following form: 

71 = 0 

The second solution usually involves a logarithmic term. If the roots of the 
indicial equation are complex, on the other hand, the solution usually 
involves sines and cosines. 



In the following sections, I examine a bit more closely the several types of 
roots you can have in indicial equations. 



Distinct roots that don't differ by a positive inteaer 

If r 2 ^ r u and r x - r 2 isn't a positive integer, the second solution, y 2 , is given by 
the following: 



l + 2>„(r 2 )x' 

n = 1 



x^O 



Part III: The Power Stuff: Advanced Techniques 



Because these two series: 
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and: 



and: 

l + |>„(r 2 )x" 

n = 1 

are analytic at x = 0. The behavior of the solutions at x = 0, where there's a 
regular singular point, is entirely due to these terms: 



and 




That's why r x and r 2 are called the exponents at the singularity, as I explain 
in the earlier section "Finding the indicial equation" — they determine what 
happens at the singular point. 



Equal roots 

What if the roots r x and r 2 are equal? In that case, y 2 takes the following form: 
y 2 = yM\x\ + \x''\Y l b n (r l )x" x>0 

n = 1 

You have to calculate the coefficients, b„, as usual: You substitute this equa- 
tion into the differential equation, collect terms, set the coefficients of x equal 
to zero, and get a recurrence relationship working. 



ajftNG/ Roots that differ by a positive integer 

If the roots of the indicial equation differ by a positive integer, r, - r, = N, things 
get complex pretty quickly And you can't use a solution, y 2 , of this form: 



Y2=\x 



x^O 



Why? Well, because if r x - r 2 = N, you would start overlapping with the y } 
solution: 



yi=\x : 



1 + 2X0-,)*" 
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So what does the second solution look like when r 1 -r 2 = AT? Here's what it 
turns out to be: 
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ay,ln|x| + \ x' 2 



Here's what the constant a looks like (which may be zero): 
a = Iim (r-r 2 )a N (r) 

r r 2 

Here, a N is the Mh coefficient , where r l -r 2 = N, and 
d 
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Chapter 11 

^^Mgwithl^place Transforms 

In This Chapter 

Looking at the elements of a Laplace transform 
Determining whether a Laplace transform converges 
Figuring some Laplace transforms 
Using Laplace transforms to solve differential equations 
Getting a grip on factoring, convolutions, and step functions 



rhis chapter is all about a powerful new tool for handling particularly 
tough differential equations. This tool is called a Laplace transform, which 
is a type of integral transform; you use it to change a differential equation 
into something simpler, solve the simpler equation, and then invert the trans- 
form to recover the solution to your original differential equation. Cool, huh? 
Read on for all the details. 

Breaking bovOn a Typical 
Laplace Transform 

To get to know Laplace transforms, start by taking a look at what a general 
integral transform looks like: 

p 

F(s) = f K(s,t)f(t)dt 

a, 

In this case, f(t) is the function that you're taking an integral transform of, and 
F(s) is the transformed function. The limits of integration, a and (3, can be 
anything you choose, but the most common limits are -°° to +00. And here's 
the key to the transform: K(s, f) is called the kernel of the transform, and you 
choose your own kernel. The idea is that choosing your own kernel gives you 
a chance to simplify your differential equation more easily. 
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Who was Laplace? 



^err^SiMnlaplWe (March 23, 1749-March 5, 
1827) was a French mathematician and 
astronomer. One of his most important contribu- 
tions was his five-volume work, Mecanique 
Celeste {Celestial Mechanics), in which he laid 
the groundwork of modern mathematical astron- 
omy. This work was used by Sir Isaac Newton. 



Laplace was responsible for what is now called 
Laplace's equation andforthe Laplace transform 
(which is important to mathematical physics). 
The Laplacian operator, which is a differential 
operator that's central to many areas of physics, 
also is named after Laplace. 




When you restrict yourself to differential equations with constant coeffi- 
cients, as you do in this chapter, a useful kernel is e st . Why? Because when 
you differentiate this kernel with respect to t, you end up with powers of s, 
which you can equate to the constant coefficients. Here's what this process 
looks like: 



F(s) = fe-t(t)dt 

0 

Note that besides using the kernel e~ st , the limits of integration in the previous 
transform are from 0 to <x> because negative values of t would make the inte- 
gral diverge. 

The symbol for Laplace transforms is L {/(0}> which is the Laplace trans- 
form of f(f): 

c{f(t)}=F(s) fe-*f(t)dt 



bedding Whether a Laplace 
Transform Converges 

A potential difficulty exists with Laplace transforms: Sometimes an integral 
won't converge. Frequently, integrals with infinite ranges don't converge, and 
if the Laplace transform of a function won't converge, it won't be of any use 
to you in solving differential equations. 
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Take the following equation, for example: f(f) = e'. The Laplace transform for 
this equation is: 

DropBooks, 

0 

So here's what the new and improved transform looks like: 

F{s)= fe~ s dt 

^^^^^^^^^^^^^^^^^^^^ 
Taking the e~ s factor outside the integral leaves you with this equation: 

F{s) = e~ s fdt 

d 

This equation is all fine and good, but integrating it gives you: 
F(s) = te-<\; 



And for finite values of s, this equation tends toward infinity instead of con- 
verging, which is obviously a problem. 




So how do you know if a Laplace transform exists in finite form? It's time for a 
theorem. But first, I start by defining what it means for the function f(f) to be 
piecewise continuous. The function f(f) is piecewise continuous if both of the 
following are true: 



f(t) is continuous on each subinterval < t < f„ where i stands for the 
number of the interval 

f* f(f) stays finite as the endpoints of each subinterval are approached 
(from inside the subinterval) 




Now that you're armed with that definition, here's the theorem that helps you 
determine whether a Laplace transform exists for your particular function: 



If /(f) is piecewise continuous in the interval 0 < f < a for any positive a, 
and I /(f) I < Ce at where f > K, where C, a, and K are real and positive, 
then the Laplace transform F(x) = t. \f(t )} exists for s> a. 



Calculating Basic Laplace Transforms 



In this section, you can take a look at how to calculate some basic Laplace 
transforms. Enjoy! 
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The transform of 1 



ction, you start off by calculating just about the easiest Laplace 
there is — the Laplace transform of 1. Here's what that transform 
looks like: 



f{l} = /e-(l)tf 

6 

Integration gives you: 

£{l}= [ e~"{\)dt=\ s>0 

6 

So the Laplace transform of 1 remains finite for all 5 > 0, and it depends on the 
value you choose for s. 



The transform of e at 



Now move on to solving the transform of e at : f(f) = e"'. Here's what the Laplace 
transform looks like: 

£{e"'}= fe-"e°'dt 

0 

With a little simplifying, this equation becomes: 

£{e°'}= fe-' s -°>'dt 

0 

And this, in turn, becomes the following after integration: 

£{e"'}= f e ^' 1 ' dt= -gk-a s>a 

0 

Again, this result depends on the value you choose for s. 



The transform of sin at 



The Laplace transforms in the previous two sections don't look so bad. How 
about now trying your hand at the Laplace transform of some trig functions, 
such as sin at? Here's the Laplace transform of sin at, which I calculate in the 
following sections: 



£{s\nat}= f s'mat e " dt 
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Integrating bg parts 

So|how_do you go about tackling the integration to this tricky transform? 

have to be crafty here. The best way to solve this transform is to 
by parts, giving you: 



■— ^ •— ^ soinow a 
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£{smat}= e ~ S ' c ° sat |r~f fcosat e" dt 



Wow, did all that work buy you anything? Well, sure! It turns out that the first 
term is 1/a (substituting in 0 for f), so this breaks down to: 



/; {sinaf} = ^-§ fcosat e" dt 



Here's where the clever part comes in. Note that the second term has become 
similar to the original integral, except that it uses cosine. Maybe if you inte- 
grate by parts again, you'll get back to an integral that uses sine. And if that's 
the case, maybe you can actually factor £ {sinaf} onto the left side, which 
would leave you with some reasonable expression on the right. 



Integrating the previous transform by parts again gives you: 
£{smat} = ^-^j Jsinat e"'dt 

^ 0 



Simplifying the result 

After going through the previous section, you may be asking yourself: "Is this 
just getting worse and worse?" Actually, no. Things truly are improving — 
note that the second term is s 2 /a 2 multiplied by £ {sinaf }. So this transform 
becomes: 

£ {sinaf} = q - £ {sinaf } 

It turns out that you have been clever after all, because you can recast the 
equation this way: 

« 2 1 
£ {sinaf } + £ {sinaf} = 



Or even simpler, you get: 
^£{sinaf} = l 
which becomes: 



/{sinaf} = , a , s>0 
L 1 s +a 



Can that be it? Yes, that's £ {sinaf }. Great work! 
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Consulting a handy table for some relief 



e in the previous sections, things can become complex pretty fast 
bmes to calculating Laplace transforms. Are you going to be expected 
to jump through these kinds of hoops each time you need a Laplace transform? 
If so, wouldn't it just be easier to hit yourself on your head with a brick? 

Thankfully, you usually don't have to jump through those hoops very often. 
Instead, you can use some handy tables of Laplace transforms. After all, why 
reinvent the wheel? Check out Table 11-1, which is designed to save you a lot 
of work. 

Keep in mind that the Laplace transform of f(i) is defined this way: 
£{F(t)}=F(s)= fe-f{t)dt 

d 

So the Laplace transform depends on the value you choose for s. 



Table 11-1 Laplace Transforms of Common Functions 



Function Laplace Transform Restrictions 











1 


1 

s 


s>0 




e at 


1 

s- a 


s> a 




f" 


n\ 

s" + ' 


s > 0, n an integer > 0 




cos at 


s 

s 2 +a 2 


s>0 




sin at 


a 

s 2 +a 2 


s>0 


cosh at 


s 

2 2 


s>\a\ 




s - a 




sinh at 


a 

s 2 -a 2 


s>\a\ 


e at cos bt 


(s 2 -a 2 ) + b 2 


s> a 


e at sin bt 


b 

(s 2 -a 2 ) + b 2 


s> a 



t" e at '—^ s > a, n an integer > 0 

(s-a) 

f[ct) \c{f(slc)} c>0 

f lnl (r) s"£{f(t)} - s""7(0) - s f 1 "- 21 ^) - ^"-"(O) 
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Soltfinq Differential Equations 
^pQ(B(U^3ace Transforms 



Now here comes the fun stuff: using Laplace transforms to solve differential 
equations. Take a look at this differential equation, for example: 

y" + 3y' + 2y = 0 

The initial conditions for this equation are: 

y(0) = 2 

and 

/(D) = -3 

"Wait a minute," you say. "I know how to solve this! You know that to solve 
this equation you just assume a solution of the following form: 

y = ce at 

Then you plug into the original equation to get: 

caV + 3cae at + 2ce at = 0 
Dividing by ce"' gives you: 

a 2 + 3a + 2 = 0 
which becomes: 

(a + 1) (a + 2) = 0 
So a = -1 and -2, which means that the solution is: 

y = c x e* + c 2 e 2 ' 
Now, matching the initial condition y(0) = 2 means that: 

y(0) = Cj + c 2 = 2 
Take the first derivative of the solution, which gives you: 
y' = -Cxe~* + -2c 2 e' 2 ' 
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4? 



So y'(0) = -3 gives you: 

Ci + -2c 2 = -3 

And solving y(0) = Ci + c 2 = 2 and y'(0~) = -Ci + -2c 2 = -3 results in: 
c,= 1 

and: 

c 2 =l 

So the general solution is: 

y = e' + e 2 ' 

Excellent, you solved the problem with traditional techniques. Now try doing 
the same thing using Laplace transforms in the following sections. Having 
already solved the problem means that you can check the answer you get. 
And beginning with this relatively simple problem will show how to use 
Laplace transforms to solve differential equations. 

A feu) theorems to send you on your May 

To start solving the example problem, you need a few more theorems. You've 
figured out how to do a number of individual Laplace transforms, but what 
about doing the Laplace transform of an equation like this one: 

y" + 3y' + 2y = 0 

^beh The Laplace transform is a linear operator 

The first theorem I want to introduce you to says that the Laplace transform 
is a linear operator: 



Because the Laplace transform is a linear operator, this is a true statement: 

£{c 1 f 1 (t)+C 2 f 2 (t)} = C 1 £{f 1 (t)}+C 2 £{f 2 (t)} 

In other words, the Laplace transform of the sum of two terms is the sum 
of the Laplace transforms of those two terms. 

Taking the Laplace transform of the differential equation you want to solve 
gives you: 



£{y" + 3y' + 2y} 
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which becomes: 
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So vou've 



;}+3£{y'}+2£{y} 



So you've made some progress in solving differential equations already — as 
you can see, you can break things up by terms, which is a great help. 




The Lap face transform of a first derivative 

Okay, so you already know something about the term £{y} — that's the 
Laplace transform of the function y(x). But what about the x{y'} term? That 
brings me to the next theorem: 

Say that /(f) is continuous and f'(f) is piecewise continuous in an interval 
0 < t < a and there exist constants C, p, and 8 such that I /(f) I < Ce"' for f > 5. 
In that case, £ [f'{t )} exists for s > P, and: 

£{f'(t)}=sM{f(t)}-r(0) 




The Laplace transforms of hiaher derivatives 

What about £ {f"(t)}, £ {f'"(t)}, all the way up to £ {/ w (f )}? It turns out that 
you can apply the previous equation over and over to find the higher deriva- 
tives. Here's the theorem that formalizes this application: 



Say that /(f), f '(f), f "(f) • • • f in '\t) are continuous and /" Cn) (f) is piecewise con- 
tinuous in an interval 0 < f < a and there exist constants C, P, and 5 such 
that I f(t) I < Ce*', I /•'(/) I < Ce"' , I f "(f) I < Ce pf ... I f M (0 1 < Ce 1 " for f > 8. 
In that case, £ {/" (n) (f )} exists for s > P, and: 

£{f { *>(t)} = s" £ {/■(/)} - s-'f (0) - s/ -( "- 2) (0) - f ( "-"(0) 



Soivlnq a second order 
homogeneous equation 

Alright, now that you're armed with the theorems from the previous section, 
you're ready to solve this differential equation in the following sections: 

y" + 3y' + 2y = 0 

In general, here's how the process works: 

1. Figure out the Laplace transform of the differential equation. 

2. Solve the equation algebraically. 

3. Try to find the inverse transform. 
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Using Laplace transforms in this process has one major advantage: It changes 
a differential equation to an algebraic equation. The only sticky part is finding 
forms and inverse transforms of the various terms in the differential 
(and that's what the tables of Laplace transforms are for). 



You can generalize the solution technique used in the upcoming problem to 
the general second order differential equation ay" + by' + cy = /(f). It turns out 
that the Laplace transform of the solution to this differential equation is: 



£{y(s)}- 



(as+b)y{0) + ay'{0) | t{f(t)} 



bs - 



as + bs + c 



Note that when you use this equation, you don't have to find the solution to 
the homogeneous version of the differential equation first — doing so isn't 
necessary when you use Laplace transforms. 

Finding the Laplace transform of the equation's unknown solution 

Taking the Laplace transform of the differential equation (see the earlier sec- 
tion "The Laplace transform is a linear operator") gives you: 

£{y"}+3£{y'}+2£{y} 

Then, using the theorem from the earlier sections on the Laplace transforms 
of derivatives, you get: 



£{y"}=s 2 £{y}-sy(Q)-y'(0) 



and 

£{y'}=s£{y}-y(0) 

After plugging these two derivatives into the Laplace transform of the original 
differential equation, you get this result: 

s 2 £{y} -sy(0) -y'(0) + 3[s£{y} -y(0)] + 2£{y) = 0 
Collecting terms gives you: 

{s 2 +3s + 2)£{y}-(3 + s)y(0)-y'(0) = 0 
Now you can use the initial conditions: 

y(0) = 2 

and 



y'(0) = -3 
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in the collected version of the equation's Laplace transform, which gives you: 
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Or. more : 



3s + 2)£{y}-(6 + 2s) + 3 = 0 
Or, more simply: 




(s 2 +3s + 2)/;{y}-2s-3 = 0 



Moving all the terms to the correct spots gives you this result: 
2s + 3 



V+3s + 2) 



Factoring the denominator leaves you with this equation for the Laplace 
transform of the differential equation's solution: 



2s + 3 



(s+ l)(s + 2) 



discovering a function to match the Laplace transform 

Now you have to find a function whose Laplace transform is the same as the 
previous solution. To do that, use the method of partial fractions, and then 
write the solution as: 



2s + 3 



(s+l)(s + 2) (s+1) (s + 2) 
And now you have to figure out what a and b are. To do so, write the 

2s + 3 _ a(s + 2) + 6(s+l) 



fractions as: 

*{y} 



(s+l)(s + 2) (s+l)(s + 2) 
At this point, you can equate the numerators in the fractions to get: 

2s + 3 = a (s + 2) + b(s + 1) 

Because it's up to you to choose s, you can first set it to -1 (to make it easy 
on yourself), which gives you: 

l = a 

And now you can set s to -2 to get: 
-1 =-b 

or: 



1 =b 
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Okay, so a = 1 = b. You have these fractions: 

} 



Substituting for a and b gives you a more detailed Laplace transform of the 
differential equation's solution: 



*{y} 



i i 



(s+1) (5 + 2) 




UncoVerinq the inverse Laplace transform 
to get the equation's solution 

Whew. After you know what the Laplace transform of the solution looks like, 
it's time to find the inverse Laplace transform to find the actual solution to 
the differential equation. 

Your calculator isn't going to have an inverse Laplace transform £~ l \ } 

button on it (and if it does, I'd be glad to buy it from you). Your best bet, 
then, is to use a table, like Table 11-1 earlier in this chapter, to find the form 
of the transform that you're dealing with. Then you simply have to find the 
function whose transform that is. 

From Table 1 1-1, you can see that the Laplace transform of e at is: 

This transform looks promising. You can use this information to get the 
inverse transform. Take a look at the first term: 

1 



(5+1) 

Comparing this to the Laplace transform of e al tells you that in this case, 
a = -1, so the first term in the differential equation's solution is: 

y, = e' 

Now look at the second term: 
1 

(5 + 2) 

Comparing this to the Laplace transform of e m tells you that a = -2, so the 
second term in the differential equation's solution is: 

y 2 = e 2 ' 
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And the solution to the differential equation is y = y x + y 2 , which equals this 
final result: 
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This solution is confirmed by your earlier solution (which you determined at 
the very beginning of this section). But this time, you did it with Laplace 
transforms. Not too bad, huh? 

Soivinq a second order nonhomoqeneous 
equation 

Ready for another example? How about this little gem: 

y" + y = -15 sin At 
where 

y(0) = 2 

and 

/(0) = 5 

"Hmm," you say, "I think I know how to solve this one as well." Good! You 
must have read Chapter 6! So, you likely know that you should first take a 
look at the homogeneous equation: 

y" + y = 0 

And because it looks like sines and cosines would work, you can assume a 
solution of the following form: 

y = Qsin t + c 2 sin t 

Now you need a particular solution. The right side has a term in sin At, so try a 
similar term here. Doing so would give you this form for the general solution: 

y = Qsin t + c 2 cos t + c 3 sin At 

Plugging this into y" + y = -15 sin At gives you: 

-CiSin t- c 2 cos t- 16c 3 sin At + Qsin t + c 2 cos t + c 3 sin At = sin At 
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So c 3 = 1, 



Or, with some simplification you get: 

,c 3 sin f = -15 sin 4f 

c 3 =T, and so far, your general solution looks like this: 

y = CiSin t + c 2 cos t + sin At 

Now you can use the initial conditions to determine c, and c 2 . Here's y(0): 

y(0) = c^in f + c 2 cos t + sin 4f = c 2 = 2 

So c 2 = 2. So far, your general solution looks like this: 

y = Qsin t + 2 cos t + sin At 

Now you can determine c t with the last initial condition, which means that 
you have to calculate y'QJ). Here's whaty' looks like: 

y' = CiCos t - 2 sin t + 4 cos 4f 
And here's y'QJ): 

y'(0) = c, + 4 = 5 
So Ci = 1. And the general solution is: 

y = sin t + 2 cos f + sin 4f 

Okay, very nice. You obviously have been paying attention! Now, in the fol- 
lowing sections you can try the same thing using Laplace transforms. 

Determining the Laplace transform 

Here's the differential equation you're trying to solve with the Laplace trans- 
form, in case you forgot: 

y" + y = -15 sin At 

To begin, take the Laplace transform of it, using the relation from the earlier 
section "The Laplace transforms of higher derivatives": 

£{y}=s 2 £{y}-sy(0)-y'(0) 

So here's your differential equation: 

s> £ { y }-sy(0)-y(0) + l{y} = ^_ 
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where you've put in the Laplace transform of sin At, according to Table 11-1. 
Here are the initial conditions for this problem: 



and 

y'(0) = 5 

Substituting these initial conditions into the previous equation gives you this 
result: 



s 2 £{y}-2s-5 + £{y} 



-15 



(s 2 +16) 

Or, with some simplifying you get: 

-15 



(^ + I)x{y}-2 S -5 V+16) 
Now, taking 2s + 5 over to the right side gives you: 

( s2+1 ) z W = (?Ti6) +2s + 5 1 

Be careful, because you're into some heavy algebra now! After the calcula- 
tions, the equation works out to be: 



-is^^k^ 

1 s+i JM>7 ( s 2 +i6) 



Next, after expanding the terms you get the following equation: 

f e t , i', r r„l _ -15 + 2s 3 +32s + 5s 2 +80 

which works out to become: 

, r i = 2s 3 + 5s 2 + 32s + 65 
ty J (s 2 +l)(s 2 +16) 

Matching a function to the Laplace transform 

Wow. How the heck do you expand the previous equation using partial frac- 
tions so you can find a function to match the transform? It's actually pretty 
easy! You simply break it up and assume a form like this: 

as + b , cs + d 



£ [ v \ = as + o_ 



s 2 +l s 2 +16 
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which is: 
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} 



(as + b)(s 2 + 16) + (cs + d)(s 2 + 1) 



(s 2 +l)(s 2 +16) 
Now tackle the numerator. The first term is: 

(as + 6)(s 2 + 16) 
Multiplying this out gives you: 

as 3 + I6as + bs 2 + 166 
The second term in the numerator is: 

(cs + d)(s 2 + 1) 
After you multiply the term out, you get: 
cs 3 + cs + ds 2 + d 

Adding the two terms that you multiplied out gives you this form for the 
numerator: 

as 3 + 16as + bs 2 + 16b + cs 3 + cs + ds 2 + d 

Or, after some simplifying: 

(a + c)s 3 + (b + d)s 2 + (16a + c)s + (166 + d) 

This numerator must equal the numerator in the other equation you have for 
the same Laplace transform, 2s 3 + 5s 2 + 32s + 65. So equating the two numera- 
tors gives you: 

2s 3 + 5s 2 + 32s + 65 = (a + c)s 3 + (6 + d)s 2 + (16a + c)s + (166 + d) 

Does this really buy you anything? Well, it still looks like a cubic equation. 
And it still is a cubic equation, but the powers of s must be equal on the two 
sides of the equation, so you have these relations: 

a + c = 2 
6 + d=5 
16a + c = 32 
166 + d = 65 
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Solving these equations for a, b, c, and d gives you the following: 
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c = 0 
d= 1 

Here's your equation for the Laplace transform: 



as + b , cs + d 



+ 



(s 2 +l) (s 2 +16) 
Expanding this gives you: 



as ft cs d 



(s 2 +l) (s 2 +l) (s 2 +16) (s 2 +16) 
Finally, plugging in values for a, b, c, and d gives you: 



2s 1 1 



+ / , 7T + 



s 2 +l) (s 2 +l) (s 2 +16) 



Ws/w# f/ie handy table to find the inverse Laplace transform 

So the general solution, after you check Table 1 1-1 and plug in all the right 
numbers, is: 

y = sin t + 2 cos t + sin At 



As you may have noticed, this solution agrees with the one you got earlier in 
this chapter using the traditional method. Great work. 



Soivinq a higher order equation 

Try out this ever-popular higher order differential equation in the land of 
Laplace transforms: 

y w -y-0 

where: 

y(0) = 0 

y'(0) = i 

y"(0) = 0 

y"'(0) = o 



Part III: The Power Stuff: Advanced Techniques 



Laplace t; 

d Boats 



So now you probably want to know how to go about solving y w -y = 0 using 
Laplace transforms. The following sections will show you how. 



out the equation's Laplace transform 

A fourth derivative may seem dreadful, but the fact that three of the four ini- 
tial conditions are zero will definitely help. Here's the Laplace transform of 

y (4) -y = 0: 

s i £{y}-s 3 y(0)-s 2 y'(0)-sy"(0)-y"'(0)-£{y}=0 

This equation looks like it has the potential of being a tough nut to crack, but 
substituting the initial conditions simplifies things, giving you this: 

s*£{y}-s 2 -£{y} = 0 

Looks a lot more manageable, doesn't it? Solving for 



(as + b)(s 2 + 16) + (cs + d)(s 2 + 1) 



(s 2 +l)(s 2 +16) 



£{y] gives you: 



i 
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Unearthina a function to match the Laplace transform 

Now the plan is to get the transform from the previous section into a form 
that's recognizable in Table 11-1. You can use partial fractions to do just that. 
Because s 4 - 1 = (s 2 + 1) (s 2 - 1), you can write the previous transform in the 
following format: 



as + b cs + d 



s 2 -\ s-'+l 
Adding these terms together gives you: 

(as + b){s 2 +l) + (cs + d){s 2 -l) 



i 



The numerator here must equal the numerator in the other equation you 
have for £ {y}. Equating the numerators gives you: 

s 2 = (as + £>)(s 2 + 1) + (cs + d)(s 2 - 1) 

Don't forget that you can choose the value of s yourself. For example, if you 
choose s to equal 1, the previous equation simplifies to: 



1 = 2(a + b) 
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How about if you choose s = -1? Then you get this result: 



Adding these two equations together gives you: 
2 = 46 

So: 

b = l A 

Substituting 6 = H into 1 = 2(a + 6) gives you: 

1 = 2(a + X) 
Or with some simplification: 

1 = 1 + 2a 

So: 



Okay, so a = 0 and 6=1. How about c and dl You can set 5 = 0 in 2s 2 = 
(as + b)(s 2 + 1) + (cs + d)(s 2 - 1) to get: 



Or: 

b = d 

And because 6 = Y>, d = l A also. 

Alright, that gives you a, 6, and d. But you still have to figure out c. Take a 
look at your equation that equated the two numerators: 

s 2 = (as + 6)(s 2 + 1) + (cs + <f)0 2 - 1) 
Note that equating the cubic terms on the two sides gives you this equation: 

0 = as 3 + cs 3 
But because a = 0, this becomes: 

Q = cs 3 




0 = 6-c/ 
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So c = 0. That gives you: 
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c = 0 
d= l A 

Substituting these numbers into the Laplace transform gives you this more 
detailed result: 

So, as you can see, having used the initial conditions in the problem has sig- 
nificantly simplified the form of the Laplace transform. 

Getting the equation's inverse Laplace transform 

After you have the Laplace transform, check out Table 11-1 for the inverse 
transform, and then plug in the correct numbers. Here's the result you 
should get: 

y= ^(sin/j t + sinf ) 

Factoring Laplace Transforms 
and Convolution Integrals 

Sometimes, the Laplace transforms you end up with require a little extra 
work to solve. But no worries; you just have to be a little creative. And in the 
following sections, I explain how to do just that. For instance, I show you how 
to factor a Laplace transform into a sum of fractions and how to work with 
convolution integrals. 




Factoring a Laplace transform 
into fractions 

When you face an especially funky-looking Laplace transform, factoring the 
denominator and the numerator often helps. For example, imagine that you 
end up with this Laplace transform when solving a differential equation: 



*{y} 



5 + 4 

+ 4s + 8 
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There's no entry in Table 1 1-1 that matches this transform. But the form of 
the denominator indicates that you may be able to factor it. Here's what the 
may look like: 



4s + 8 = (s + 2J + 2 l 

This equation looks somewhat more promising, don't you think? You can now 
convert your original transform into this new form: 



s + 4 



(s + 2) +2 2 



Hey, wait a minute. This expression isn't in Table 1 1-1 either. But take a closer 
look at the numerator; you can factor it as well. For instance, you can rewrite 
the numerator like this: 

s + 4 = (s + 2) + 2 

This in turn gives you the following for the Laplace transform: 

, , (s + 2) + 2 

Or, with a little simplifying you get: 
(s + 2) 2 



(s + 2) +2 2 (s + 2) +2 2 



Doesn't this look a whole lot better? According to Table 11-1, you can now 
find the inverse Laplace transform, which is: 

£{y} = e" 2 ' cos2f + e" 2t sin2f 



Checking out convolution integrals 

The example in the previous section factored a Laplace transform into a sum 
of fractions. But what if, instead of a sum, you end up with a product of recog- 
nizable Laplace transforms? What do you do then? 

For example, what if you had this Laplace transform: 

s 2 (s + a) 

Looking at Table 1 1-1, you can see that the inverse transform of this expres- 
sion doesn't appear. However, if you write this Laplace transform as: 

11 s 2 (s + a) 
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then you can see that this is the product of the Laplace transforms for t and 
sin at. This product brings you to an important question: Can you write the 




.aplace transform this way: 
'} = t sinaf 



Nope, it doesn't work like that. The inverse of the sum of Laplace transforms 
is the sum of the inverses of the individual Laplace transforms, but it doesn't 
work that way when you multiply Laplace transforms together. Instead, you 
have to turn to convolution integrals, as defined in the following theorem: 

If: 

£{f(t)}£{g(t)} = £{h(t)} 
then: 

h(t)= j f{t-a)g{a)da 

0 

which also equals: 

h{t) f f(a)g(t-a)da 

0 

where a is a new variable. The integrals in these transforms are called 
convolution integrals. 

Sometimes you may see the convolution operation denoted with an asterisk 
(*), like this: 

Ki) = (f*g)(f) 

Using this new operator means that you can write the products of Laplace 
transforms in much the same way that you would use the multiplication 
operator: 

fitf) * 0 = 0 * f(f) = 0 

Kf) * (g(f) + f (0)= m * SCO + f® * KO 

Armed with this theorem, you can now tackle the example problem: 

15 s 2 l s + a ) 2 
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These terms are the Laplace transforms of t and sin at. So you can write the 
inverse Laplace transform like this: 



j (t- a) sin(af) da 



which equals: 



Swtfeyinq Step Functions 

In the world of Laplace transforms, there's an interesting function called the 
step function, which looks like this: u a (t). In the following sections, I break 
down the elements of the step function, and I show how it relates to Laplace 
transforms. 



Defining the step function 

The function's value is defined as 0 up to a certain point, a, but then as 1 
thereafter. Here's the definition of the step function in equation form: 



«.(0 



0 t<a 



[I t>a 

As an example, if a = 0, you have that u 0 (f) equals: 
TO f<0 



"o(0 : 



1 t>0 



Note that the subscript on the u indicates the point at which the step func- 
tion "steps." 

And if a = 1, you have that Ui(t) equals: 
f0 f<l 



«>(0 



1 t>\ 



You can see what u a (f) looks like graphically in Figure 11-1. 
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The step 
function in 
graph form. 




Figuring the Laplace transform 
of the step function 

Now that you're familiar with the step function, go a bit further and take the 
Laplace transform of the step function: 

£{u a (t)}= fe- s, u a (t)dt 

0 

Substituting the step function into this transform gives you the following result: 

£{u a (t)}= fe-'dt 

a 

Note that the lower limit of the integral has become a. Why? Because the inte- 
gral is zero up to that point. Now this equation becomes: 

c{u a {t)} = ^ 5>0 

And that brings me to a new theorem: 
If a is a positive constant, then: 

C{u a {t)f(t-a)}=e-£{f{t)} 

This theorem can help you with Laplace transforms that have exponentials in 
them. To see how, try finding the inverse Laplace transform of this equation: 



1 -e" 



Begin by breaking it into the following: 



*{y} 



i 
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That is, for t < 1 
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Using the theorem, you can find the inverse Laplace transform: 



y(f) = t 
and for t > 1: 

KO = i 

So the step function helped you find a Laplace transform. Pretty cool, right? 
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Chapter 12 

Tacking Systems of First Order 
Linear Differential Equations 



In This Chapter 

Brushing up on matrix basics 
Handling matrix operations 

Checking out linear independence, eigenvalues, and eigenvectors 
Working out homogeneous and nonhomogeneous systems 



• ••••• 



This chapter is all about systems of differential equations, where a system 
is a set of linear differential equations that share some common vari- 
ables. In this chapter, I show you how to apply many of the techniques used 
to handle systems of standard algebraic equations to solving systems of dif- 
ferential equations. 

Being able to handle systems of differential equations is useful in two cases: 

When you want to reduce the order of a differential equation to a system 
of first order differential equations 

is* When you have a problem that consists of interdependent differential 
equations — such as when you have an electrical circuit with linked 
loops in it that share the current (don't worry; I won't delve into such 
science here) 

This chapter is heavy in its use of matrices, which are usually used to solve sys- 
tems of linear equations. After you brush up on the fundamentals of matrices, 
you find out about some important concepts, such as linear independence, 
eigenvalues, and eigenvectors. I wrap up the chapter by explaining how to 
solve both homogeneous and nonhomogeneous systems. 
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)k at the following system of three simultaneous equations: 

x + y + z = 6 
x-y-z = -4 
x + y-z = 0 

How do you solve this system of equations for x, y, and z? A fair bit of algebra 
is involved here, so to keep things straight, you can use a matrix. You're most 
likely already familiar with matrices, but in the following sections, I go over 
the fundamentals just in case you need to refresh your memory. 




Setting up a matrix 



Simply put, a matrix is a set of numbers arranged into columns and rows, 
like this: 





a. 


a 3 


&, 


b 2 






c 2 


c 3 



When creating a matrix, you place the coefficients of each equation in a row. 
For instance, a h a 2 , and a 3 are from one equation; b u b 2 , and b 3 are from a 
second equation; and c u c 2 , and c 3 are from a third equation. Similarly, the first 
coefficient of any equation is in the first column; the second coefficient of any 
equation is in the second column; and the third coefficient of any equation is 
in the third column. (I'm sure you get the idea!) A matrix can contain as many 
rows and columns as you need. 

Putting numbers into rows and columns like this helps you keep track of 
them. (Neatniks rejoice!) For example, you can represent the coefficients in 
these equations: 

x + y + z = 6 
x-y-z = -4 
x + y-z = 0 



like this: 



1 1 
1 -1 
1 1 
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And to keep track of the constants on the right side of these equations, you 
can create what's called an augmented matrix. With this type of matrix, a ver- 
i keeps the constants on the right sides of the equations separate 
^coefficients on the left sides of the equations, like this: 



can create 



1 


1 


1 




6 


1 


-1 


-1 




-4 


1 


1 


-1 




0 



Working through the algebra 

After you set up a matrix, it's easy to keep track of the algebraic manipula- 
tions involved in solving the system of simultaneous equations. Here, you're 
going to work on the individual rows. 



You can see how this works using the matrix you set up in the previous sec- 
tion. Remember that your goal is to solve for x, y, and z. First, add the second 
row to the first and place the result in the first row, making sure that you 
leave the second row intact. Doing all this gives you: 



Now divide the first row by 2 to simplify: 



1 


0 


o 1 




I 


1 


-1 


-1 




-4 


1 


1 


-1 




0 



Next, add -1 times the first row to the second row and place the result in the 
second row: 



1 


0 


0 




1 


0 


-1 


-1 




-5 


1 

v. 


1 


-1 




0 



Then multiply the second row by -1: 



1 


0 


0 




'1 


0 


1 


1 




5 


1 


1 


-1 




0 
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Add -1 times the first row to the third row and place the result in the third 
row, like so: 
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0 




1 


1 




5 


-1 




-1 




Now add -1 times the second row to the third, placing the result in the 
third row: 



1 


0 


o 1 




1 


0 


1 


1 




5 


0 


0 


-2 




-6 



Finally, you divide the third row by -2: 



1 0 0 
0 1 1 
0 0 1 



Note that you now have a triangular matrix on the bottom left; in other words, 
the bottom left triangle's elements all equal zero. This triangle simplifies mat- 
ters considerably, because this new augmented matrix now represents this 
system: 



x= 1 

y + z = 5 
z = 3 



And from the latter two equations, finding the solution for y is pretty trivial: 
y = 2. Now you've solved for all three variables. Nice work. 



Examining matrices 




Did you know that you can name matrices? Yup, that's right. In matrix terms, 
a name is denoted in bold. For instance, you can name the following matrix, 
which contains both real and complex elements, A (imaginative, I know): 



1 2 + 2/ 
3 + 3/ 4 
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The transpose of a matrix swaps its rows and columns; in other words, the 
rows become the columns, and the columns become the rows. Here's what 
pose of A (called A 7 ) looks like: 



[ 1 
2 + 2/ 



3 + 3/ 
4 



You can also define the complex conjugate of a matrix. To denote a complex 
conjugate, you simply add a line above the name of a matrix. The complex 
conjugate of a matrix is simply the complex conjugate element by element of 
the matrix. Here's the complex conjugate of A, where you flip the sign of the 
imaginary part: 

1 2-2/ 
3-3/ 4 



The adjoint of a matrix is the transpose of the complex conjugate of the 
matrix. You denote an adjoint by adding an asterisk (*) to the name of 
the matrix. Here's what A* looks like: 



A* = 



i i-3/i 

2-2/ 4 



Mastering Matrix Operations 

After you're familiar with the basics of matrices, you can take the next step 
and start working with a variety of matrix operations, such as addition, sub- 
traction, multiplication, and other fun stuff. I explain what you need to know 
in the following sections. 



Equality 



Two matrices are considered equal if every element in the first matrix is 
equal to the corresponding element in the other matrix. For instance, if: 

fl 2) 
A= 3 4 



And: 



B 



1 2 
3 4 



then A = B. Easy enough, right? 
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ed to, you can add two matrices together. Doing so involves adding 
ents at corresponding positions in the two matrices. For example, if: 



fl 2 1 




5 6 




and B = 




i 3 4 ; 


7 8 




1 


2 


+ 


<5 6 1 




6 8 


3 


4 


7 8 




10 12 




then: 

A + B 

And just so you know: A + B = B + A. 

Subtraction 



Like matrix addition, matrix subtraction works as you'd expect: element by 
element. For example, take a look: 



A-B 



Note that A-B doesn't equal B - A. In fact, as you'd expect, A - B = -(B - A), 
as you can see here: 



B-A 



1 2 1 




5 6 1 




f-4 -4' 


3 4 




7 8 ; 




-4 -4 



5 6 1 




1 T 




f4 4 


7 8 ; 




3 4 ; 




4 4 



Multiplication of a matrix and a number 

In some cases, you need to multiply a matrix by a number; to do so, you multi- 
ply each element in the matrix by that number. For example, 4A looks like this: 



4A = 4 



1 2 1 




4 8 


3 4 ; 




12 16 



Multiplication of two matrices 

How about multiplying two matrices together, such as A and B? Unfortunately 
this is a little more involved than just adding them. It turns out that AB is 
defined when the number of columns in A is the same as the number of rows in 
B. That is, if A is an / x m matrix (that's row x column notation, so A has / rows 
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and m columns) and B is an m x n matrix, the product AB exists — and the 
product is an / x n matrix. 

here's how it works: the (i,f) (that's row, column) element of C is 
found by multiplying each element of the zth row of A by the matching ele- 
ment in the y'th column of B. Then when you add the products you get: 

m 

C v = 2 A m B kj = A a B y + A i2 B 2j + A a B 3j + ...+A lm B mj 



Now put in the numbers: 



AB = 



1 2 1 




(5 6 


3 4 t 




7 8 



Applying the rules of multiplying matrices, you get: 



1 2 1 




5 6 1 




r 5 + 14 6+16 




19 22 


3 A t 




7 8 ; 




15+28 18 + 32 




43 50 



One thing to note is that in general, AB * BA. Using the same example, here's 
what BA looks like: 



'5 6 1 




1 V 




5+18 10+24 1 




23 34 


7 8 ; 




3 4 ; 




7 + 24 14 + 32 




31 46 



Multiplication of a matrix and a Vector 

You'll often see matrices that only have one set of rows or one set of 
columns. These matrices are called vectors. For example, here's a vector with 
one column: 

1 

2 
3 

Here's a vector with one row: 



(1 2 3) 

Sometimes you'll see vectors that are used to hold variables, as in this one, 
which I'll call x: 



x 
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With vectors, you can express a set of simultaneous equations like this: 
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X 




3 




y 




4 




z 




5 





This set of simultaneous equations can be written as: 
Ax = b 



Identity 



The identity matrix, which is labeled I, holds Is along its upper-left to lower- 
right diagonal, and all Os otherwise. Here's a 2 x 2 identity matrix (with 2 rows 
and 2 columns): 



I 



1 0 
0 1 



And here's a 3 x 3 identity matrix (with 3 rows and 3 columns): 

1 0 0 
0 1 0 
0 0 1 

Multiplying any matrix, A, by the identity matrix gives you A again. (I explain 
how to multiply two matrices together earlier in this chapter.) For example, 
take a look at the multiplication of a matrix called A and the 3x3 identity 
matrix: 





'1 


2 3 




'1 


0 


0 ] 




1 


2 3 


AI = 


4 


5 6 




0 


1 


0 




4 


5 6 




7 


8 9 




0 


0 


1 




7 


8 9 



The Inverse of a matrix 

If you have simultaneous equations such as these: 

x + y + z = 6 
x-y-z = -4 
x + y-z = 0 
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1 (l 1 -lj \z\ { 0 

You can further simplify this so that it looks like: 
Ax = b 



where: 





1 




1 


1 


A = 


1 




-1 


-1 




1 




1 


-1 




X 








x = 


y 

z 










' 6 1 






b = 


-4 
0 







Wouldn't it be nice if you could solve for x by some way dividing Ax = b by A 
to get the following: 

x = A 'b 

Doing so would give you the solutions, x, y, and z, to your simultaneous equa- 
tions. So can you find A" 1 ? Yes, you sure can! This is called the inverse of A 
(and A" 1 A = I, where I is the identity matrix). So how do you find the inverse 
of a matrix? You can choose from several ways, but the easiest is the one that 
I present in the following sections. 




Generally, to find the inverse of a matrix A, apply the steps to A in order to 
reduce it to the identity matrix I (that is, Is along the upper-left to lower-right 
diagonal and Os otherwise). Then apply those same steps, in the same order, 
to the identity matrix. You should end up with A" 1 . To wrap up, simply solve 
for x by multiplying A" 1 and b. 



Before I can explain how to find an inverse, I need to cover an important con- 
cept that's helpful when you're working with inverses: determinants. Read on 
for details. 
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Finding the determinant of a matrix 

Ar| important quantity when it comes to matrices is the determinant. The 
^"JieL^i^ftant reduces a matrix to a single significant number; whether that 
ViiinBMs zero is important for inverses as well as other calculations. For 
example, when checking to see whether the solutions you get to a system of 
linear differential equations are linearly independent (and form a general 
solution), you need to use determinants. (I discuss linear independence in 
more detail later in this chapter.) 

So how do you find a matrix's determinant? Here's an example that can show 
you how. Say you have this 2x2 matrix, called A: 

a b 
c d 

The determinant of A, written as det(A), for a 2 x 2 matrix is defined this way: 
det(A) = ad-cb 

For example, here's a 2 x 2 matrix with some specific numbers: 

1 2 
A= 3 4 



What's its determinant? Just plug the numbers into ad - cb, like so: 
det(A) = (l)(4)-(3)(2)=-2 

How about a 3 x 3 determinant? Say you have this 3x3 matrix A: 

a b c 
A= d e f 
g h i 

Be careful here! Determinants rapidly become more complex beyond 2x2. 
Here's what the determinant of the 3x3 matrix is: 



cJJVBE/? 



det(A) = aei - afh - bdi + cdh + bfg - ceg 

Findina the inverse of a matrix 

To find the inverse of a matrix A, apply the steps you need to A to reduce it 
to the identity matrix, I (that is, Is along the upper-left to lower right diagonal 
and Os otherwise). Then apply those same steps, in the same order, to an 
identity matrix, and you'll end up with A -1 . 
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Take a look at an example. For this system of equations: 
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+ z = 6 
-z = -4 



x + y-z = 0 



matrix A looks like this: 



1 1 1 

1 -1 -1 

v 1 1 _1 

Find A" 1 by first reducing A to I. To do so, add -1 times the first row to the 
third row and place the result in the third row: 

1 1 1 

1 -1 -1 

0 0-2 

Now divide the third row by -2 to simplify: 

1 1 1) 



1 -1 
0 0 



Add the second row to the first row and place the result in the first row: 
(2 0 0) 



1 -1 
0 0 



Next, divide the first row by 2 to simplify: 

1 0 0 
1 -1 -1 

0 0 1 

You're looking good. Now add -1 times the first row to the second row and 
place the result in the second row: 

1 0 0 
0 -1 -1 
0 0 1 
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Almost there. Add the third row to the second row and place the result in the 
second row: 



DBookp» 



[0 0 1 

Finally, multiply the second row by-1 to get that final 1: 

1 0 0] 
0 1 0 
0 0 1 

And there you have it — the identity matrix. 

After you reduce a system to the identity matrix, you have to apply the same 
sequence of steps to the identity matrix to find A" 1 . Here's the 3x3 identity 
matrix: 

1 0 0 
0 1 0 
0 0 1 

Now follow the same steps that you followed earlier in this section. First, add 
-1 times the first row to the third row and place the result in the third row: 

10 0 
0 1 0 
-1 0 1 

Divide the third row by -2: 



1 0 
0 1 

Vz 0 



0 
0 

-Yi 



Next, add the second row to the first row and place the result in the first row: 
'11 0 " 



0 1 

Vz 0 



0 



Divide the first row by 2: 

'Vz Vz 0 
0 1 0 
Vi 0 
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And add -1 times the first row to the second row and place the result in the 
second row: 
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A 0 -Vt j 

Now add the third row to the second row, placing the result in the second row: 



Vt A 0 
0 !4 -y 2 
A 0 -A 



Finally, multiply the second row by -1: 

V» A 0 ' 
0 -|/ 2 Vi 
X A 0 -V% 

And there you have it: A" 1 . 



Sotting for x urith a tittle multiplication 

Now you have to find x, the solution to your system of equations, by using the 
equation x = A~'b. Your equation looks like this when you fill in the numbers: 



V 




fl A A 


0 


6 


y 




0 -1/2 


A 


-4 


z 




A 0 


-A 


0 



Performing matrix multiplication (as I describe earlier in this chapter) 
gives you: 



X 




1 


y 




2 


z 




3 



Voila! It worked. You found the solution to your simultaneous equations by 
finding the inverse of a matrix. 

Does solving for x always work? The answer is a resounding no. Why? 
Sometimes matrices can't be inverted (in which case they're called singular, 
or non-invertable, matrices). 
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How can you tell if a matrix is singular before attempting to find its inverse? 
You can check to see whether its determinant is zero. Matrices whose deter- 
ire zero are singular matrices without an inverse; matrices whose 
Jants aren't zero do have an inverse. In the original matrix in my 
example, the determinant is: 



you can cn 
^mljan^ir 
^/ef\i^Tjai 



det(A) = aei - afh - bdi + cdh + bfg - ceg 



HaVinq fun With Eigenvectors V Things 

You're now ready for more insight into matrices using eigenvectors and 
eigenvalues. What are those? Read on to find out more. 



Linear independence 

Determining whether a set of vectors is linearly dependent can be quite 
important. It's especially important when you're solving systems of linear dif- 
ferential equations to see whether you have linearly independent solutions. 
You need to get a linearly independent set of solutions to make sure you have 
the complete solution. 



Say, for example, that you have a set of vectors, Xj to x*. They're said to be 
linearly dependent if there are constants, c x to c k , such that: 



ClXi + C 2 X 2 + . . . C k TL k = 0 




where 0 is a vector whose elements are all zero. In other words, Xi to x ft are 
considered linearly dependent if a linear relation relates them. If there are no 
constants, Ci to c h (not all zero), such that this equation holds, the vectors, X[ 
to x ft , are linearly independent. 

How do you determine whether a set of vectors, X] to x,,, is linearly indepen- 
dent? You can assemble all the vectors, X! to x fc , into a single matrix and then 
check the determinant. If the determinant is zero, the vectors are linearly 
dependent. If the determinant isn't zero, the vectors are linearly independent. 
I walk you through an example in the following sections. 



Assembling the Vectors into one matrix 

Say that you have the following vectors: 

2 
4 
-2 
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i x H 

>oksl 



-8 
2 

-22 

Now you can assemble these vectors into a 3 x 3 matrix called x: 

'22 -8~ 
4 1 2 
-2 3 -22 

determining the determinant 

Okay, so now you have to figure out whether the determinant of x is zero. As 
discussed earlier in this chapter, the determinant of a 3 x 3 matrix A: 

a b c 
A= d e f 
g h i 

is the following: 

det(A) = aei - afh - bdi + cdh + bfg - ceg 
So the determinant of x in my example is: 

(2)(lX-22) - (2)00(3) " (2)(4)(-22) + (-8)(4)(3) + (2)(2)(-2) - (-8)(l)(-2) 
which becomes: 

-44- 12 + 176-96-8- 16 = 0 

As you can see, the determinant in this case is zero. Uh-oh. That's no good. 

The determinant is zero, which means that x u x 2 , and x 3 are linearly depen- 
dent. What should you do next? Remember the following: 



CiXj + c 2 x 2 + ...c k x k = 0 
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What are c u c 2 , and c 3 ? You can figure out those constants by solving the aug- 
mented matrix. Here's your matrix: 



-2 3 -22 



Add the first row to the third row and place the result in the third row: 



2 2 
4 1 
0 5 



2 

-30 



Next, divide the first row by 2 to simplify: 



1 1 
4 1 

0 5 



-4 
2 

-30 



Now add -4 times the first row to the second row (to get a zero in the first 
position of Row 2). Place the result in the second row: 



1 


1 


-4 1 




0 


0 


-3 


18 




0 


0 


5 


-30 




0 



Divide the second row by -3 to simplify: 



1 


1 


-4 1 




'0 


0 


1 


-6 




0 


0 


5 


-30 




0 



Add -5 times the second row to the third, and then place the result in the 
third row: 



1 


1 


-4 1 




'0 


0 


1 


-6 




0 


0 


0 


0, 




0 



This matrix corresponds to a system of these two equations: 



Ci + c 2 - 4c 3 = 0 
c 2 - 6c 3 = 0 
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You can choose one of these constants arbitrarily. So, just for kicks, set c 3 = 1. 
If you plug this constant into the previous two equations and do a little alge- 
^4ari^a«ill find that c 2 = 6 and Ci = -2. 

Putting it aft together 

Now it's time to assemble your constants and your vectors so you can check 
your work. So: 





2 1 




2 1 




' -8 1 




c, 


4 


+ c 2 


1 


+ c 3 


2 






-2 




3 




-22 





becomes: 



2 1 




2' 




' -8 1 




0 


4 


+ 6 


1 


+ 


2 




0 


-2 




3 j 




~ 22 > 




0 



As you can see, you've determined c u c 2 , and c 3 correctly. 



Eigenvalues and eigenvectors 

Take a look at this vector equation: 
Ax = y 

When facing problems like this, it sometimes helps to consider A in a form 
where a linear transformation converts x into y. That is, you want to look for 
solutions of the following form: 

Ax = Xx 

In this case, X stands for a constant. You can rewrite this equation as: 
(A-XT)x = 0 

This equation has a solution only if (A - XT)' 1 exists. In other words, you can 
be assured of a solution if: 

det(A - XT) * 0 

Any values of X that satisfy (A - XI) x = 0 are called eigenvalues of the original 
equation. And the solutions x to (A - XT) x = 0 are called the eigenvectors. 
You can see how eigenvalues and eigenvectors work in the example that I go 
through in the following sections. 
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Changing the matrix to the right form 

Hare's an example you can wrap your brain around: Try finding the eigenval- 
envectors of the following matrix: 

1 

4 

First, convert the matrix into the A - XI form. Doing so gives you: 
-1 -X -11 

A-Xl- 



Figuring out the eigenvalues 

Next, it's time to find the determinant: 

det(A - XI) = (-1 - A,)(-4 -X) + 2 



or: 

det(A-M) = ?i 2 + 5?i + 6 
which can be factored into the following: 

det(A - XI) = X 2 +5X + 6 = (X + 2)(X + 3) 
So, by equating this equation to 0, the eigenvalues of A are X t = -2 and X 2 = -3. 

Calculating the eigenvectors 

How about finding the eigenvectors of A? To find the eigenvector correspond- 
ing to Xi, you have to substitute Xi (-2) into the A - XI matrix, like so: 



A-Xl- 



Because (A - XT)x = 0, you have: 



1 


-r 








0 


2 


-2 




X, 




0 



And, because every row of this matrix equation must be true, you can 
assume that Xx = x 2 . So, up to an arbitrary constant, the eigenvector corre- 
sponding to Xi is: 

(1 
C 1 
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You can also drop the arbitrary constant, and write this eigenvector as: 



ipBDOr# 



How about the eigenvector corresponding to X 2 1 By plugging X 2 (-3) into the 
A - XI matrix, you get: 



A ll 



2 -1 
2 -1 



Then you have the following: 



2 


-r 








0 


2 


-i 








0 



So 2xi -x 2 = 0 and Xi = x 2 /2. This means that up to an arbitrary constant, the 
eigenvector corresponding to X 2 is: 

1 

2 



Again, you can drop the arbitrary constant, and simply write this 
eigenvector as: 



1 

2 



Solving Systems of First-Order Linear 
Homogeneous Differential Equations 

You've likely discovered how to work with systems of linear equations in 
algebra classes. If so, you're in luck because working with systems of linear 
differential equations follows the same techniques. In the following sections, 
I give you a good look at systems of first order linear homogeneous differen- 
tial equations with constant coefficients like this: 

x 2 ' = 4#i + x 2 

These differential equations are linked — that is, both contain x t and x 2 . As 
such, they have to be solved together. (Flip to Chapter 5 for an introduction 
to working with constant coefficients in homogeneous equations.) I show you 
how in the following sections. 
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rite a set of equations such as X\ ' = x x + x 2 and x 2 ' = 4x\ + x 2 in this 
rm: 




\x[ ' 




1 


1 




X, 


[x' 2 




4 


1 




x 2 



Or, shorter still, you can write the matrix like this: 
x' = Ax 

Here, x', A, and x are all matrices: 

4 1 

(x^ 

If A is a matrix of constant coefficients, you can assume a solution of the fol- 
lowing form: 

x = %e 

Okay you say what's that funny squiggle © doing there? Actually it's the 
Greek letter xi in lowercase form. It couldn't possibly stand for eigenvector, 
could it? You're right! You're way ahead of me. 

Substituting your supposed form of solution, x = %e rt , into the system of differ- 
ential equations, x' = Ax, gives you: 

where r is a constant. Do you see how using matrix notation makes working 
with systems of differential equations easier? Now you can subtract A£e rt 
from both sides of the equation and do a little rearranging to get: 



(A-rI)£e r '=0 



or: 



(A-rI)£ = 0 
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As you may recall from the earlier section on eigenvalues and eigenvectors, 
this is exactly the equation that specifies the eigenvalues and eigenvectors of 
ijjx A. So the solution to the system of differential equations, x' = Ax, 
Jjf (provided that r is an eigenvalue of A and ^ is the associated 
eigenvector). 



Making your u/ay through an example 

Now take a closer look at the example I give in the previous section: 







<\ 


V 




X, 


x[ 




4 


l j 







Because this matrix has constant coefficients, you can try a solution of the 
following form: 

x = %e" 

I walk you through the steps of solving this system in the following sections. 



Getting the right matrix form 

The next step you have to tackle is substituting x = %e" into the matrix, which 
gives you: 





— 


i r 










4 l j 







By subtracting the left side from both sides of the equation, you can rewrite 
this as: 



(T 




<l-r 1 1 






0 




4 1-r 







Dividing by e" gives you: 



0 




1-r 1 1 






0 ; 




4 1-r 







Finding the eigenvalues 

This system of linear equations has a solution only if the determinant of the 
2x2 matrix is zero (see the earlier section "Linear independence" for 
details). So: 



det 



'1 



1 



0 
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After expanding, your equation looks like this: 



which becomes: 

r 2 - 2r + 1 - 4 = 0 
Or, with some simplification: 

r 2 -2r-3 = 0 
Finally, you can factor this into: 

(r-3)(r+ 1) = 0 
So the eigenvalues of your 2x2 matrix are: 
r, = 3 

and 

r 2 = -l 

Coming up With the eigenvectors 

After you find the eigenvalues, you need to find the two eigenvectors. 
Plugging the first eigenvalue from the previous section, r x = 3, into the matrix 
yields this result: 



ow-2 n r; 

0=4 -2 I ^ 2 



With some simplification you get: 



-2§i + %2 = 0 



and: 



These equations are the same up to a factor of -2. So you get: 
25i = fc 
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The first eigenvector is (up to, as usual, an arbitrary nonzero constant that 
doesn't matter): 



How about the second eigenvector? It corresponds to the eigenvalue r 2 = -1. 
So plugging that into the matrix gives you: 



> r 








1 2 / 









After simplification you get: 
and: 

4?, + 2^ 2 = 0 

These equations give you the same information as with the first eigenvector: 
25i=-5 2 

So the second eigenvector becomes: 







-1 






2 



Summing up the solution 

The first solution to the original system of differential equations, based on 
the first eigenvector and eigenvalue, is: 

1 



The second solution, based on the second eigenvector and eigenvalue, is: 
-11 



The general solution to this system is a linear combination of these two solu- 
tions (c,x, + c 2 x 2 ), which in this example looks like: 



x = c 



1 




-1 


2 


e 3 '+c 2 


2 
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The solution can also be written as: 



DropBooWD 




XA (1 

c, „ 



e +c 



By splitting up this equation, the solutions to the system of differential equa- 
tions become: 

Xi = Ci e 3 ' - c 2 e 1 



and 

x 2 = 2ci e 3 ' + 2c 2 e* 
That example wasn't so bad, was it? 



Sotting Systems of First Order Linear 
Nonhomogeneous Equations 

Now I want you to turn your attention to systems of first order linear nonho- 
mogeneous differential equations. I show you how to solve this system of 
homogeneous differential equations in the previous section: 








1 


1 




'x 1 






4 


1 







But what if the situation was changed to this: 



' x[ 1 




1 


r 




'Xi 




\-2e- 


x[ 




4 








+ 


3t 



The solution to the nonhomogeneous system is the general solution of the 
homogeneous version of the system (which you already have from the previ- 
ous section) plus a particular solution. 

In the following sections, I show you how to assume the form of the solution 
and determine the missing coefficients — all in a way entirely analogous to 
the method of undetermined coefficients in linear nonhomogeneous differen- 
tial equations (see Chapter 6 for an introduction to this method). 
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Assuming the correct form 
D TO P B 0 Gitf^&P particular solution 




'\ r 




+ 


-2e r 


+ 


0 




4 1 


x 2j 




0 




3t 





So how can you find a particular solution to a nonhomogeneous system? 
Easy: By using the method of undetermined coefficients after it has been gen- 
eralized to work with matrices. To do that, rewrite the system like this: 

x'. 

It's clear that the last two terms in this system involve terms in e* and t, so 
can you assume a solution of the following form? 

x = ae ' + bt + c 

Well, not so fast. As you may recall from the previous section, the eigenvalue 
of the general solution to the homogenous equation here was -1. So there's 
already a e"' term in the general solution. 

What do you do in cases like this? You do just what you would do for a single 
differential equation — you have to add a term in te '. That makes your 
assumed solution look like this: 

x = ate'' + be'' + ct + d 

Here's what your system of differential equations looks like currently: 

x = Ax + 



-2e- 




0 




+ 




0 




3f 



Plugging x = afe ' + be ' + ct + d into this system gives you 
■ ate~' - be'' + c = Aa?e~' + Abe~' + Ac? + Ad + 



ae 





+ 


0' 


0 




3? 



And equating coefficients on the two sides gives you these results: 



-2 
0 



Aa = -a 


Ab = a 


-b 




0 


Ac=- 


3 




Ad = c 
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Crunching the numbers 



uming the correct form of your solution, you're ready to do the 
the following sections, I explain how to calculate all your missing 
coefficients. Remember that A is the following: 

[I 1 
4 1 

Finding a 

When you start calculating the missing coefficients, why not start with find- 
ing a? In this case, Aa = -a becomes: 



1 


V 








a l 


4 


1 




a. 




a 2 



Or, in simpler terms: 
£/[ + a 2 = - <2i 

and: 

Aa x + a 2 = -a 2 
These can be rewritten even more simply as: 



2a x = -a 2 



and: 

4a! = -2a 2 

These equations differ by a factor of 2. Because you're only interested in a 
single particular solution, go with a x = -1 and a 2 = 2, which gives you: 

-1 



Finding b 

Now find b. You already know the following: 

-2) 



Ab=a-b 



0 
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So after plugging in your solution for a, you get: 





-r 




V 




-2 




2 j 








0 



Or, more simply: 
26, + b 2 = 1 

and 

\b x + 26 2 = 2 

A solution to these equations (which only differ by a factor of 2) is: 

1) 
-1 

Finding c 

Ready to find c? You already know the following: 



Ac 



So in other words, you get: 

1 llfcil fO 
4 1 c " ~ 3 



Here's what you get after simplifying: 

Ci + c 2 = 0 

and: 

4C[ + c 2 = -3 

The solution to these equations, after a little number crunching, is: 

-n 

1 
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Finding d 

Finally you just have to find d. You know that Ad = c. In other words, by plug- 
ur solution for c you get: 



d\ + d 2 = -1 



and: 



4c?! + d 2 = 1 

So the solution to this pair of equations is: 



Winding up your Work 



After going through the previous sections and assuming a form of the solu- 
tion and crunching the numbers, you just have to put the work together to 
get a particular solution to your original system. That particular solution is: 









V 




(-W 


f 2 /3 ' 






te' + 


-1 


e" + 




t+ 






2 t 
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iscovering Three Fail-Proof 
Numerical Methods 



In This Chapter 

Brushing up on the Euler method 

Taking it to the next level with the improved Euler method 
Getting great results with the Runge-Kutta method 



/3 group of elite computer scientists shuffles into your office with a prob- 
v \ lem: "We're not comfortable writing software that solves differential 
equations. Isn't there an easier, more computer-friendly way of handling 
differential equations?" 

"Well," you say, "you can use the method of undetermined coefficients and 
then solve for . . ." 

"Solve for?" the group asks. "You mean using variables? No, no — we want 
something numeric. " 

"Ah," you tell them. "You want methods like Euler's method and the Runge- 
Kutta method." You show them some programming code. 

"That's it!" the group cries, grabbing your code and running off. 

"My bill," you call after them, "will be in the mail." 

"Better use e-mail," cries a junior member, disappearing around the corner. 

Differential equations can stump even the best and brightest, but I have a 
secret weapon for you: numerical methods. This chapter is all about the 
computer-based methods that you can use to solve differential equations 
when everything else fails. Do remember that you'll get numbers out of these 
techniques, not elegant, finished formulas. But sometimes, numbers are just 
what you want, as is often the case in engineering. 
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In this chapter, I use the Java programming language, so if you want to follow 
along, you need to install Java on your computer. It's free when you visit 

.. When you're at the Web site, simply click the Java SE link and 
and install the Java Development Kit, or JDK. 



aiong, you 



Number Crunching vOith Euler's Method 

Euler's method, which I introduce in Chapter 4, allows you to handle differen- 
tial equations in a numeric way. In the following sections, I explain the basics 
of the method, and then I show you how to enter code into your computer so 
you can see the method in action. 



The fundamentals of the method 

Take a look at this differential equation: 
dy 



dx 



-f(x,y) 



The standard Euler's method notes that you may not have the actual function 
that represents the solution to your differential equation. However, when 
you're armed with the preceding equation, you do have the slope of that 
curve everywhere. That is, the rate of change of the curve is the derivative. 
(See Chapter 1 for a refresher on derivatives.) 

Say that you have a point, (x 0 , y 0 ), that's on the solution curve. Because of 
the preceding equation, you know that the slope of the solution curve at that 
point is f(x 0 , yo). Suppose that you also want to find the numeric solution at 
a point, (x, y), a short distance, h, away. Here's how Euler's method says that 
you may find y. 

y = y 0 + Ay 

In other words, y is equal to y at an initial point, plus the change in y. 

Because the slope, m, is defined as Ay/Ax (a change in y divided by a change 
in x), this equation also can be written like this: 

y = y 0 + m Ax 

And because Ax = x-x 0 , this equation is also: 



y = y 0 + m(x-x 0 ) 
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Here's the key: The slope m is equal to the derivative at (x 0 , y 0 ), and because 
of your original differential equation, you know that m = f(x 0 , y 0 ~). So you have: 



oi your or 

oks 



+ f(*o,yo) (x-xq) 




Now convert (x - x 0 ) to the symbol that it usually goes by when you discuss 
Euler's method: h, which gives you this equation: 

yi=y 0 + f(x 0 , yo) h 

This equation can be generalized to any point, (x„, y„), along the solution 
curve like this: 

y n ♦ i = y„ + f(x„, y n ) h 

And there you have it — you've discovered the recurrence relation, which ties 
one term to the next, for Euler's equation. (Flip to Chapter 9 for an introduc- 
tion to recurrence relations.) 



Usinq code to see the method in action 

Now try testing the basics from the previous section, using this differential 
equation: 

where y(0) = 0. 

I'll spare you the details of solving this equation with traditional methods 
(but you can head to Chapter 4 to find out how to do so). Without further 
ado, here's the exact solution: 




Because you know the exact solution, you can check the accuracy of Euler's 
method in Java code. The following sections show you how. 

Typing in the code 

In Chapter 4, 1 develop a short Java program, e.java, to display the results of 
Euler's method versus the exact solution. The code starts at (x 0 , yo) = (0, 0), 
which you know is on the solution curve because of the initial condition, 
y(0) = 0. The code calculates 100 steps, using a step size of h = 0.1. 
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If you want to follow along, start by using the Java compiler, javac.exe, to 
compile e.java: 




ivac e . j ava 



If javac.exe isn't in your computer's path, you have to specify that path this 
way to run javac.exe: 

C : \>C : \ jdk\bin\ javac e.java 



After compiling e.java, you should get a new file, e. class. Now you can exe- 
cute the compiled code, e. class, using java.exe like this: 



C : \> j ava e 

Here's the code that you're going to modify in this chapter (note that the 
sections of the code that you have to change when you're solving your own 
differential equations are given in bold): 



public class e 
{ 




double xO = 0.0; 
double yO = 0.0; 
double h = 0.1; 
double n = 100; 




public e() 

{ 

} 




public double f (double x, double y) 
{ 

return x; 

} 




public double exact (double x, double y) 
{ 

return x * x / 2 ; 

} 


public static void main (String [] argv) 
{ 

e de = new e ( ) ; 
de . calculate ( ) ; 

} 


public void calculate ( ) 
{ 
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double x = xO ; 
double y = yO ; 
^touble k; 

System. out .print In ( "x\t\tEuler\t\tExact " ) ; 

for (int i = 1; i < n; i++) { 
k = f (x, y) ; 
y = y + h * k; 
x = x + h; 

System. out .println (round (x) + "\t\t" + round(y) + 
"\t\t" + round(exact (x, 0 ) ) ) ; 



public double round (double val) 
{ 

double divider = 100; 

val = val * divider; 

double temp = Math . round (val ) ; 

return (double) temp / divider; 

} 

} 

Surveying the results 

After being run, the code will display the current x value, the Euler approxi- 
mation of the solution at that value, and the exact solution, like this: 



C: 


: \ >java e 










X 




Euler 


Exact 


0, 


. 1 


0. 


.0 


0. 


.01 


0, 


.2 


0. 


.01 


0. 


.02 


0, 


.3 


0. 


.03 


0. 


.05 


0. 


.4 


0. 


.06 


0 


.08 


0, 


. 5 


0. 


.1 


0 


.13 


0, 


.6 


0. 


.15 


0 


.18 


0, 


.7 


0 . 


.21 


0 


.24 


0, 


. 8 


0 . 


.28 


0 


.32 


0. 


,9 


0. 


.36 


0. 


.4 


1. 


,0 


0. 


.45 


0. 


, 5 


1, 


, 1 


0. 


,55 


0. 


, 6 


1. 


,2 


0. 


,66 


0. 


,72 


1. 


,3 


0. 


,78 


0. 


,85 


1. 


.4 


0. 


.91 


0. 


,98 


1. 


, 5 


1. 


.05 


1 . 


,13 


1. 


,6 


1. 


.2 


1 . 


,28 


1. 


,7 


1. 


,36 


1 . 


.45 


1. 


,8 


1. 


.53 


1. 


, 62 
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06 


4 . 


21 


3 , 
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Not bad. Euler's method came pretty close to the exact solution. In fact, at a 


value of x = 


9.9, Euler's method is still within 1% of the exact solution. 



Moving On Up With the Improved 
Euler's Method 

As I explain in the earlier section "The fundamentals of the method," the 
recurrence relation for the Euler method is given by: 

y n ♦ i = y n + f(x„, y,d h 
where the differential equation you're trying to solve is: 
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Well, it tin 



This is a fairly simplistic method; it just extrapolates from the current point 
to the next point using the known slope. What if the actual solution varies 
n the Euler method takes into account? 



Well, it turns out that an improved Euler method exists. This method, which 
is also called the Heun formula, can be more accurate. I explain everything 
you need to know in the following sections. 



Understanding the improvements 

The standard Euler method assumes that the difference between y„ tl and y„ is: 

Ay = f(x n ) h 

For simplicity's sake, assume that f(x, y) is only a function of x, f(x). 

This method doesn't take into account possible steep increases — or 
decreases — in the slope. A better solution would not only take the current 
slope, f(x„), into account, but it also would take the slope at the next point 
along the curve, f(x n + /?), into account. You could then take the average of 
those two slopes, like this: 



m = 





+ f(x 






2 







This is a better approximation than simply using the slope at x n , which the 
standard Euler's method does. Now you can multiply the average slope by 
the interval length, h, to find the change iny: 

Ay= ![/(*„) +f(x K +h)] 




So you can express the recurrence relation for the (new and) improved 
Euler's method like this: 



yn +i = y„+^[f{x„) + f{x n + h)} 



Coming up With neu) code 

In this section, I show you how to create a new program, e2.java, that will put 
the improved Euler method to work. The program will display the traditional 
Euler result, the improved Euler result, and the exact result. To illustrate the 
new code, I use the same equation from the earlier section "Using code to see 
the method in action" in the following sections. 
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Changes in the neu/ code 

code for the improved Euler's method is different from the one in the earlier 




Jsing code to see the method in action." Here, you create a new vari- 
in which you store the improved Euler results, and then you make 
these changes to the calculate method (the bold indicates changes in the code): 



public void calculate () 
{ 

double x = xO ; 
double y = yO ; 
double yimp = yO; 

double k; 



System. out .print In ( "x\t\tEuler\t\tImproved\t\tExact" ) ; 

for (int i = 1; i < n; i++) { 
k = f (x, y) ; 
y = y + h * k; 

yimp = y + (f(x, y) + f(x + h, y) ) * (h/2); 

x = x + h; 

System. out. print In ( round (x) + "\t\t" + round(y) + 
"\t\t" + round(yimp) + "\t\t" 
+ round (exact (x, 0 ) ) ) ; 

} 

} 

Here's what the program looks like now: 

public class e2 
{ 

double xO = 0.0; 
double yO = 0.0; 
double h = 0.1; 
double n = 100; 

public e2 ( ) 

{ 

} 

public double f (double x, double y) 
{ 

return x; 

} 

public double exact (double x, double y) 
{ 

return x * x / 2 ; 

} 
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public static void main (String [] argv) 



3 Books 



new e2 ( ) 
alculate ( ) ; 



public void calculate () 
{ 

double x = xO ; 
double y = yO ; 
double yimp = yO ; 
double k; 



System. out .print In ( "x\t\tEuler\t\tImproved\t\tExact " ) ; 

for (int i = 1 ; i < n; i++) { 
k = f (x, y) ; 
y = y + h * k; 

yimp = y + (f(x, y) + f (x + h, y) ) * (h/2); 
x = x + h; 

System. out .println (round (x) + "\t\t" + round(y) + 
"\t\t" + round (yimp) + "\t\t" 
+ round (exact (x, 0))); 



} 



public double round (double val) 
{ 

double divider = 100; 

val = val * divider; 

double temp = Math . round (val ) ; 

return (double) temp / divider; 

} 
} 

The results of the new code 

So how does the code work out? Take a look: 



C: 


: \> j ava e2 




x 
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0.13 


0.21 
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0.36 
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0.45 


0.4 


0 . 55 


0.5 
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9 
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9 
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9 
9 

As you can see, Euler's method and the improved Euler's method come out 
about the same here. They're both off by 1% at x = 9.9. 



Piuqqinq a steep slope into the neut code 

4*7 w\ The improvement in the improved Euler's method isn't often visible until you 
have steep or quickly varying slopes. For example, take a look at this differen- 
tial equation: 

dx ~ x 



where y(0) = 0. 
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Here's the exact solution (I'll spare you the calculations so you can get to the 
coding faster): 

DropBooks^ 

Okay so if the improved Euler method is truly improved, you should be able 
to see difference in this example, where the slope changes faster than in the 
differential equation in the previous section. Keep reading to find out what 
happens. 



Checking out the results 

As you can see, when you use the steeply sloping differential equation, there's 
a difference between the Euler method and the improved Euler method: 
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.3 


53194. 


59 


59160 . 


78 


56271.15 


6, 


.4 


59446 . 


94 


66009 . 


09 


62829 .24 


6, 


. 5 


66318. 


89 


7 o c 9 c 


R1 


70031.83 


6, 


.6 


73860 . 


78 


/ J Ji J . 

81764 . 


o X 

42 


77930 . 87 


6, 


.7 


82126 . 


18 


90781. 


79 


86581.59 


6 , 


. 8 


91172 . 


01 


100638 


.31 


96042 . 7 


6, 


.9 


101058 


.76 


111398 


.05 


106376.48 


7. 


.0 


111850 


.58 


123128 


.94 


117649 . 0 


7. 


. 1 


123615 


.48 


135902 


.94 


129930.29 


7, 


.2 


136425 


.51 


149796 


.23 


143294.47 


7, 


.3 


150356 


.91 


164889 


.33 


157819 . 98 


7, 


.4 


165490 


.34 


181267 


.37 


173589 .72 


7 . 


. 5 


181910 


.99 


199020 


.24 


190691.27 


7, 


.6 


199708 


.84 


218242 


.76 


209217 . 07 


7, 


.7 


218978 


.83 


239034 


.95 


229264 . 62 


7, 


.8 


239821 


.07 


261502 


.17 


250936.7 


7, 


.9 


262341 


.03 


285755 


.38 


274341 . 56 


8. 


.0 


286649 


.77 


311911 


.35 


299593.14 


8. 


, 1 


312864 


.17 


340092 


.85 


326811.32 


8. 


,2 


341107 


.13 


370428 


.94 


356122 . 1 


8. 


,3 


371507 


.8 


403055 


.15 


387657 . 87 


8. 


.4 


404201 


.83 


438113 


.75 


421557 . 64 


8. 


. 5 


439331 


.64 


475754 


.01 


457967 .27 


8. 


.6 


477046 


.59 


516132 


.42 


497039 .75 


8. 


,7 


517503 


.31 


559412 


.98 


538935.42 


8. 


,8 


560865 


.93 


605767 


.45 


583822 .28 


8. 


,9 


607306 


.34 


655375 


.61 


631876.21 


9. 


.0 


657004 


.47 


708425 


.58 


683281.29 


9. 


. 1 


710148 


.57 


765114 


.08 


738230.03 


9. 


,2 


766935 


.49 


825646 


.71 


796923 .72 



Part III: The Power Stuff: Advanced Techniques 



9.3 



dBoo1<s 

9.7 



827570.99 
892270 . 01 
961256.99 
1034766 . 18 
1113041 . 96 

9.8 1196339.16 

9.9 1284923.4 



890238.25 
959113.01 
1032505 . 07 
1110658.66 
1193828.45 
1282279 . 88 
1376289 . 52 



859572 . 67 

926396.56 

997624.71 

1073496 .4 

1154261.21 

1240179.33 

1331521.93 



Even though there is indeed a difference here (at x = 9.9, the Euler method 
is off by 3.5/6 and the improved Euler method is off by 3.4%), the difference 
isn't huge. 




Increasing your accuracy With a decreased step size 

One way to increase your accuracy is to decrease your step size. For instance, 
decrease the step size from h = 0.1 to h = 0.01. Also increase the number of 
steps from n = 100 to n = 1,000. Here are the changes to make in the code in 
e2.java: 



public class e2 

{ 



double xO = 0.0; 
double yO = 0.0; 
double h = 0.01; 
double n = 1000; 



And here's what the results look like: 
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When using the smaller step size, the Euler method and the improved Euler 
method are only off by about 0.35% at x = 9.9. Much better. 



Adding Etfen Mare Precisian With 
the Runqe-Kutta Methad 

If you don't want to use either of the Euler methods, you're in luck. There's 
another numerical method that you can use to solve differential equations: 
the Runge-Kutta method. This method gives excellent results that are even 
more accurate than the Euler or improved Euler methods. 




The method's recurrence relation 

In the Runge-Kutta method, the recurrence relation is a weighted average of 
terms: 
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1^ ^arl DBviTTToTms Mhge was a German mathe- 
matician. He was born in Havana, Cuba, on 
August 30, 1856, where hisfatherwasthe Danish 
consul. The family later moved to Bremen, 
Germany. Runge died on January 3, 1927. 

Martin Wilhelm Kutta was also a German math- 
ematician. He was born in Pitschen, Germany 
(which today is part of Poland), on November 3, 
1867. He went to the University of Breslau and 



The story of Runge and Kutta 



continued to work in Munich. He also spent a 
year at the University of Cambridge. He became 
a professor in Stuttgart, Germany, in 191 1. Kutta 
died on December 25, 1944. 

In 1901, Runge and Kutta co-developed the 
Runge-Kutta method, which is the powerful 
method that's used to solve ordinary differential 
equations numerically. 




where: 

Ci = f(x n y„) 



c 2 =f(x„+^, y„+c^ 



c,= f{ x„+ ^, y n +c 



h 

2' 



U = f(x n + h,y n + c 3 /i) 

This method can easily be adapted to the code you use earlier in the chapter, 
because f(x, y) doesn't depend on y — it's just f(x). In this case, the recur- 
rence relation becomes: 



y„ + i=y„+' 



fx. 



Working With the method in code 

Here, you put the Runge-Kutta technique to work, solving the same differen- 
tial equation that you saw earlier in the chapter: 

dy 

-T~= x 

ax 

Inputting the code 

The recurrence relation of the Runge-Kutta method looks easy enough to 
implement in a new Java program, e3.java. This new program will put the 
Runge-Kutta method to work. The new code is shown in bold. 
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class e3 




xO = O.O; 
yO = 0.0; 



double h = 0.1; 
double n = 100; 

public e3 ( ) 

{ 

} 

public double f (double x, double y) 
{ 

return x; 

} 

public double exact (double x, double y) 
{ 

return x * x / 2 ; 



public static void main (String [] argv) 
{ 

e3 de = new e3 ( ) ; 
de . calculate ( ) ; 

} 

public void calculate ( ) 
{ 

double x = xO ; 
double y = yO ; 
double yrk = yO; 

double k; 

System. out .println( "x\t\tEuler\t\tRunge- 



for (int i = 1; i < n; i++) { 
k = f (x, y) ; 
y = y + h * k; 

yrk = y + (f(x, y) + f(x + h/2, y) /2 + f(x + h/2, y) /2 
+ f(x + h, y))* (h/6); 

x = x + h; 

System. out. println( round (x) + "\t\t" + round(y) + 
"\t\t" + round(yrk) + , '\t\t ,, 
+ round (exact (x, 0) ) ) ; 



} 



Kutta\t\tExact" ) ; 



} 



} 



public double round (double val) 
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double divider = 100; 
^= val * divider; 
^le temp = Math . round (val ) ; 
return (double) temp / divider; 
} 
} 



Examining the results 

Here are the results of e3.java: 
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When you look at the results, you can see that the Runge-Kutta method beat 
the Euler method hands down. In fact, to two decimal places, the Runge-Kutta 
method nearly always nailed the correct answer. Very cool. 
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The 5 th Wave By Rich Tennant 




"I looked over your equations, Mrs. Dundt. Your 
concavity and inflection points are clean and 
there's nothing -wrong -with your velocity and 
acceleration. It might be your differentiation, but 
Ivron't be able to look at it until Thursday." 
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In this part . . . 

£ very For Dummies book features a Part of Tens, and 
who am I to break with tradition? This part is full of 
cool stuff. You discover the ten top differential equation 
online tutorials as well as the ten top online tools for solv- 
ing differential equations. If you want to get more info on a 
specific aspect of differential equations, try the tutorials. 
If you want to work with challenging differential equations 
and need a little help, take a look at the tools available 
online. 
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DropBoojss 3 U p er _|| e |pf u | Online 
Differential Equation Tutorials 



In This Chapter 

Understanding different aspects of differential equations with tutorials 
Checking out helpful notes and videos 



£ven if you think of yourself as a math whiz, you still may find yourself 
scratching your head at certain aspects of differential equations. Fear not: 
A number of differential equation tutorials are available on the Internet — and 
this chapter lists ten of my favorites. Each site deals with various aspects of 
differential equations. 

AnalyzeMath.com's Introduction 
to Differential Equations 

If you're new to differential equations, you may be looking for a brief 
overview of the topic. The Web site AnalyzeMath.com offers just that. If 
you visit www. analyzemath. com/calculus/Dif f erential_Equations/ 
introduction.html, you can read an introductory tutorial on differential 
equations. The site is run by Abdelkader Dendane, PhD, a lecturer in mathe- 
matics at United Arab Emirates University. 
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Hartfeu Mudd College Mathematics 

Drop&mmtoriat 

If you're looking for a tutorial that gives good coverage of solving first order 
ordinary differential equations, be sure to check out the Harvey Mudd 
College Mathematics Online Tutorial atwww.math.hmc.edu/calculus/ 
tutorials /odes. 



John Appleby's Introduction 
to differential Equations 

John Appleby, a professor in the School of Mathematical Sciences at Dublin 
City University in Ireland, maintains a helpful tutorial at webpages . dcu . ie/ 
-applebyj /ms225/ms225 .html. Be sure to click the links under the Tutorial 
Sheets and the Supplementary Notes headers. On his site, Appleby covers 
separable and homogeneous equations, first order linear differential equa- 
tions, second order linear differential equations, variation of parameters, 
and more. 



Kardi Teknomo's Page 

Dr. Kardi Teknomo is a research fellow at Human Centered Mobility 
Technologies in Arsenal Research (which is located in Austria). Teknomo's 
tutorial focuses on solving differential equations using numerical methods. 
You can find this great tutorial at people. revoledu. com/kardi/ tutorial/ 
ODE / index . html . 



Martin J. Osborne's differential 
Equation Tutorial 

Martin J. Osborne, a professor of economics at the University of Toronto, has 
created a superb, multipart differential equation tutorial at www. economics . 
utoronto . ca/osborne/MathTutorial / IDEF .HTM. 
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Midnight Tutor's Video Tutorial 

I J |^^) |^ I J ^) ^^j^'^looking for something fun and different, check out the Midnight 

Tutor 



Tutor's Video Tutorial, which is a video tutorial solving / - ycos(?) = cos(f) 
using separation of variables. To view the video, visit www. midnight tutor . 
com/de_xprime-xcost-xcost . html. 



The Ohio State University Physics 
department's Introduction 
to Differential Equations 

If you struggle with homogeneous and nonhomogeneous linear differential 
equations, there's still hope! Check out the Ohio State University Physics 
Department tutorial on these types of differential equations. You can find 
the site at www. physics . ohio-state . edu/~physedu/mapletutorial/ 
tutorials/dif f_eqs/intro .html. 



Paul's Online Math Motes 

Paul's Online Math Notes is an extensive set of online explanations of differ- 
ential equations. You can visit this site at tutorial . math . lamar . edu/ 
Classes /DE/DE.aspx. (Who's Paul? He's Paul Dawkins, who teaches at 
Lamar University in Beaumont, Texas.) 



S.O.S. Math 

S.O.S. Math (www. sosmath. com/dif f eq/dif f eq. html) is an all-purpose 
resource for all of mathematics, but it has an entire section on differential 
equations. S.O.S Math is a great, multipart tutorial — it's as complete a tutor- 
ial as you'll find online. 
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second or 



University of Surrey provides an excellent tutorial on first and 
second order differential equations. You can view this site at www. maths . 
surrey. ac . uk/explore/vithyaspages. Vithya Nanthakumaar, who studies 
at the University of Surrey, created the site. 
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In This Chapter 

Solving equations with handy online tools 
Plotting direction fields and graphing functions 




^kuppose you're working on a particularly hairy differential equation that 

requires some busywork. Do you need to sit and do pages of calcula- 
tions? Heck no! That's what differential equation solving tools are for! And 
tons are available. Some programs cost money — and sometimes, they cost a 
great deal of money. However, a bunch of good tools also are available for 
free online. This chapter has a sampling of those great freebies. 



AnalyzeMathxom's Runge-Kutta 
Method Applet 



The AnalyzeMath.com Runge-Kutta Applet solves a number of representative 
differential equations using the Runge-Kutta method that I explain in 
Chapter 13. You can find this applet at www. analyzemath. com/calculus/ 
RungeKutta/RungeKutta . html. A couple of cool features of this applet: 
You can increase the number of points used in the calculation, and you can 
zoom in and out. 



Coolmathxom's Graphing Calculator 



The Coolmath.com graphing calculator is a fabulous online graphing applet 
that draws functions for you. You can find this calculator at www. coolmath . 
com/ graphit/ index . html. 
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ee what the direction field for a differential equation's solution looks 
like? You're in luck! You can find a great direction field plotter at www. math, 
ubc . ca/~israel/applet/dfplotter/dfplotter .html. (Flip to Chapter 1 
for an introduction to direction fields.) 



An Equation Solder from QuickMath 
Automatic Math Solutions 

The solver from QuickMath Automatic Math Solutions is an equation solver, 
not a differential equation solver. But it's still a great tool when you need to 
factor an equation, such as a characteristic equation, to find the roots. Here's 
the Web site where you can find the solver: www.hostsrv. com/webmab/appl/ 
MSP/quickmath/02 /pageGenerate?site=quickmath&sl=equations&s2= 
solve&s3=basic. 




First Order differential Equation Solder 

Here's a cool one: the First Order Differential Equation Solver at www. cs . 
gordon.edu/~senning/desolver/index.html. With this solver you can 
use the Euler, Improved Euler, and Runge-Kutta methods to solve differential 
equations. Just select the method you want to use from the drop-down box, 
enter your equation, and then click the Submit button. You couldn't find a 
niftier math tool. 



GCatc Online Graphing Calculator 

If you're working on a tough problem and don't have a graphing 
calculator handy, you can find a good graphing calculator applet at www . 
calculator . com/calcs/GCalc .html. Just enter the function you want to 
graph and press Enter on your keyboard. It doesn't get easier than that! 
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(Books 



(View Ode Solver at www. javaview.de/services/odeSolver/ 
index . html is a numerical differential equation solver that uses the 
Runge-Kutta method in Chapter 13. ("Ode" stands for "ordinary differential 
equation.") 



Math @ CovOPVs System Solder 

The Math @ CowPi's System Solver lets you solve simultaneous equations — 
from 2 x 2 to 5 x 5. Just fill in all the blanks, and presto! You have your 
answer. This great tool is available at math, cowpi .com/ systemsolver. 

This tool also can be useful when you break a higher-order differential equa- 
tion into a system of lower-order ones. 




A Matrix Inserter from QuickMath 
Automatic Math Solutions 

When working with systems of differential equations, you work with equa- 
tions like Ax = b. The solution to an equation like this is x = A 'b, where A" 1 is 
the inverse of the matrix A. Don't feel like solving all that? Here's a tool that 
finds the inverse of matrices for you in a snap: www.hostsrv.com/webmab/ 
appl/MSP/quickmath/02/pageGenerate?site=quickmath&sl=matrices& 
s2=inverse&s3=basic. All you have to do is enter the matrix and click the 
Inverse button. 



Visual differential Equation 
Solving Applet 

The Visual Differential Equation Solving Applet at www. falstad.com/diffeq 
(which runs in browsers) lets you solve some common differential equations 
and adjust numeric parameters. 
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overview, 207 
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introduction to differential equations, 317 
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phase, 149 
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calculator, graphing 
Coolmath.com, 321 
GCalc, 322 

chain rule, 44, 65 
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linear versus nonlinear equations, 18-19 
by order, 1 7 

ordinary versus partial equations, 17-18 

overview, 17 
coefficients, undetermined. See method of 

undetermined coefficients 
complex conjugates of matrices, 269 
complex roots, 100, 164-166, 223-224 
compound interest rate problem, 55-59 
conjugates of matrices, complex, 269 
connecting slopes into integral curve, 
14-15 
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overview, 94 
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